Fine-Tuning & Local Inference

What I built

GPT-4 was too expensive for high-volume text tagging tasks.

Reduce inference costs while maintaining classification accuracy.

What I did

Fine-tuned Llama-3-8B on a custom dataset and deployed via a local inference API.

What came out of it

Achieved 90% cost reduction with equal accuracy on specific tasks.