GitHub

MitraKin/model-distillation-project

A complete knowledge distillation pipeline that compresses BERT (110M params) to DistilBERT (67M params) while maintaining high accuracy on SST-2 sentiment classification.
IEEE

CUP_CDLSTM: Civil Unrest Event Prediction Using Convolutional Neural Network, DistilBERT, and Long Short-Term Memory

Abstract: Civil unrest, a major trouble in the country's progress, requires timely detection and prevention. It causes numerous major issues, including loss of life and injury, resource depletion, ...
GitHub

Twitter Sentiment Analysis with DistilBERT, FastAPI, Streamlit, and Docker

This repository implements an end‑to‑end sentiment analysis system for Twitter‑style text using a fine‑tuned DistilBERT model, exposed via a FastAPI REST API and a Streamlit UI, fully containerized ...
IEEE

LegalDB: Long DistilBERT for Legal Document Classification

Abstract: Transformers have caused a paradigm shift in tasks related to natural language. From text summarization to classification, these models have established new state-of-the-art results on ...