6 Divisions of Data Science
- Data exploration
- Data representation and transformation
- Computing
- Modeling
- Data viz
- The science of data science
Prediction vs. Inference
Prediction
- Accuracy with new data
- ”Black box” methods like neural networks
- Located in computer science fields
Inference- Understanding input-output relationships
- Creates interpretable, well-fitting models
- Belief in a “true” underlying model
- Central to traditional statistics
Common Task Framework
Key to predictive modeling
- Reducing prediction errors over time
- Best algorithms vary with dataset type
- Focus on results, not the data’s true source
Project Ideas
https://www.kaggle.com/datasets/sveta151/tiktok-popular-songs-2022/data
- Predict how popular a song will be on tiktok given certain features?
- Merge lyrics data to dataset and do topic modeling NLP to determine common topics, phrases, etc.
https://www.kaggle.com/datasets/ludmin/billboard
- Sentiment analysis to determine if popular songs are more happy, sad, lovey, etc.
- Correlation between billboard, radio, hot1000, etc.?