[SUBMISSION] December 2024 - Module 1: Instruction tuning

[nevernever69]

December 2024 Student Submission

Module Completed

• Module 1: Instruction Tuning
• Module 2: Preference Alignment
• Module 3: Parameter-efficient Fine-tuning
• Module 4: Evaluation
• Module 5: Vision-language Models
• Module 6: Synthetic Datasets
• Module 7: Inference
• Module 8: Deployment

Changes Made

Describe what you've done in this PR:

1. What concepts did you learn?
2. What changes or additions did you make?
3. Any challenges you faced?

Notebooks Added/Modified

List any notebooks you've added or modified:

• Added new example in 1_instruction_tuning/student_examples/nevernever69
• Modified existing notebook with additional examples
• Added documentation or comments

Checklist

• I have read the module materials
• My code runs without errors
• I have pushed models and datasets to the huggingface hub
• My PR is based on the december-2024 branch

Questions or Discussion Points

Add any questions you have or points you'd like to discuss:
N/A

Additional Notes

• Tried O1-OPEN/OpenO1-SFT dataset for Supervised fine tuning and can be helpful for those looking for more examples

[burtenshaw]

This looks good. Did you push a model to the hub?

[nevernever69]

yaa as nevernever69/SmolLM2-FT-MyDataset