What are the academics like at your school?
Technically, the entire purpose of going to college is for the academics.
That being said, the academics at Yale are what you make of it. Science majors are typically more difficult than humanities, but that's the usually trend in any school. However, there are just as many students who struggle in the sciences/spend hours in lab who can bust out an English essay in under an hour...they just choose classes that cater to their own abilities.
Yale is quite good at upholding their "liberal arts education" approach to academics. Before declaring his/her major at the end of sophomore year, each undergraduate is required to take a variety of courses in different subjects. Thus, the difficulty of each class depends on the student's personal strengths and experiences.
I've had a class with 14 students, and another with 200 students. However, in both classes, the professor knew my name. Office hours and class participation are stressed, and it's definitely an asset. If you choose to never speak with your professor, chances are he/she will never know you - but then you miss out on valuable classroom experiences that could influence your future studies and current course material understanding.
The goal here is to learn for the sake of learning. There are many students who do not know what their future jobs will be, but trust that their dedication in their activities at Yale will open doors. Many students who do not necessarily consider jobs go to Teach for America after graduation, or apply for graduate school.