VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)
-
Updated
Sep 1, 2026 - Jupyter Notebook
VerifAI initiative to build open-source easy-to-deploy generative question-answering engine that can reference and verify answers for correctness (using posteriori model)
🩺🔍 Combating Biomedical Misinformation through Multi-modal Claim Detection and Evidence-based Verification
A genral RAG Search chatbot, with SoTA RAG techniques such as HyDE, Hybrid retrieval with BM25 + RRF and Cross encoder reranking. Evaluated on the BEIR scifact dataset and compared all the different pipelines i tried along the way
🩺⚡ SynthMed: Generating and Detecting Multimodal Deepfakes for Healthcare Communication
Public release of SciFCheX system developed for COM3610 Dissertation Project at the University of Sheffield. The pipeline is designed to perform fact-checking on scientific claims.
Vector vs keyword search benchmark: BM25 in Elasticsearch vs dense FAISS + MiniLM vs hybrid RRF retrieval on BEIR SciFact, behind one Retriever protocol, scored on Recall, Precision, MRR and nDCG. Python.
Domain adaption for an embedding model using unsupervised and supervised finetuning on scientific texts for the SciFact retrieval task.
Evaluating retrieval strategy bias in biomedical scientific claim verification using RAG — comparing dense, BM25, hybrid, and query-reformulation retrieval across Support Recall, Contradiction Recall, and Balance Score on SciFact.
Evidence retrieval and claim verification on SciFact: BM25 from scratch, a retrieval-vs-reasoning failure decomposition, and a fine-tuned cross-encoder. Leakage audits throughout; every number states its split and confidence interval.
RAG evaluation on BEIR SciFact: BM25, dense and hybrid retrieval with LLM answers.
Multi-agent pipeline for scientific fact-checking on SciFact: 5 retrievers (dense R@1 0.689), fine-tuned DeBERTa NLI (71.3%), calibrated Judge agent.
Banc d'évaluation du retrieval sur BEIR SciFact : métriques codées à la main, campagnes avec prédiction écrite avant mesure, runs suivis dans MLflow.
Chiral Narrative Synthesis workspace for Thinker/Tinker LoRA pipelines, semantic fact-checking, telemetry, and reviewer-ready CNS docs.
Reproducible SciFact evidence-retrieval benchmark for scientific RAG
Scientific claim verification on SciFact: hand-written BM25 plus dense retrieval, fine-tuned NLI verdicts, and abstention that states why it declined, with a FastAPI reader UI.
Verifies that each citation in a draft actually supports the claim it's attached to. Faithfulness, not existence.
Reproducible BEIR SciFact study comparing BM25, dense retrieval, chunk-aware indexing, and RRF with paired bootstrap analysis.
Reproducible BM25, vector (bge-base) and hybrid retrieval with grounded-answer evaluation on BEIR SciFact. PostgreSQL/pgvector, FastAPI, paired-bootstrap results.
A claim-level fact-checking system that uses RoBERTa to spot unsupported or contradictory scientific claims.
Retrieve-then-verify fact checking on SciFact: BM25/dense retrieval + NLI vs LLM
To associate your repository with the scifact topic, visit your repo's landing page and select "manage topics."