Ph.D. Candidate in Computer Science
Hi everyone! I am Saqib, a fifth year Ph.D candidate at department of Computer Science at Stony Brook University, working at the Language Understanding and Reasoning (LUNR) lab under Professor Niranjan Balasubramanian. My research focuses on improving the code generation ability of language models using a plethora of techniques ranging from synthetic teacher distillation to preference optimization. Outside of work, I enjoy exploring the latest advancements in current affairs and the restaurant scene around my current town.
Developed GenAI systems for automated SOP creation and analysis of large-scale databases using advanced retrieval augmented generation techniques, problem-centric tool creation and multi-agent framework.
Conducted research on developing novel weight initialization for deep learning models, improving the paraemeter efficiency of neural networks using compression techniques and integrating active learning optimization strategies for efficient fake news detection.
Built a real-time streamlit application that uses LLM agents and retrieval augmented generation to verify scientific claim validity. The system retrieves relevant scientific documents and generates responses based on the retrieved context.
Analyzed the ability of LLMs pretrained on sequences other than natural language. Observed that LLMs pretrained on structured sequences such as code and scientific reports exhibit stronger performance on downstream tasks compared to those pretrained on natural language.
Developed a novel training methodology that combines weak supervision and active learning to enhance named entity recognition performance with minimal annotated data.
Analysed the various elements affecting the Covid-19 vaccination rates across different counties in the United States. This project involved analyzing vaccination rates using socio-economic variables & tweet sentiment, and developing models to predict future vaccination rates for each county.
Download my complete curriculum vitae for detailed information about my academic background, research experience, and accomplishments.
Download CV (PDF)Always open to discussing research, collaborations, and new opportunities in NLP.
CS Department • Stony Brook University • Stony Brook, NY