Srirangam, Tamil Nadu, India · Team Lead at Tekcogent Solutions · Technical Mentor, Google Developers Group
🌐 Portfolio: divithraju.github.io
I started as a Data Engineer building large-scale ETL pipelines, and now lead AI engineering: LLM-powered systems, RAG pipelines and production ML infrastructure built on a strong data foundation. I also mentor engineers and write about AI and data engineering.
- 🚀 Currently: Team Lead – AI Engineering at Tekcogent Solutions
- 🔭 Building: friendlyetl-PKG, an open-source, zero-code ETL framework on PyPI
- 👯 Open to collaborate on: Immigration-Data-Engineering
- 🤝 Looking for help with: Hadoop-Connectors-Master
- 🎓 Mentoring: Technical Mentor and member of Google Developers Group, 15+ engineers mentored
- 📝 Writing: AI and data engineering articles on Medium
- 📫 Reach me: LinkedIn · divithraju@gmail.com · Linktree
- AI and GenAI: LLMs, RAG, LangChain, Hugging Face, vector databases, multi-agent systems, MLOps
- Data engineering: PySpark, Airflow, Kafka, Flink, dbt, Hadoop, data warehousing
- Cloud: AWS, GCP, Azure, Snowflake, Databricks
- Platform: Docker, Kubernetes, CI/CD, Grafana, Prometheus, Slurm, Linux
- Languages and databases: Python, SQL, PostgreSQL, MySQL, MongoDB, Cassandra
- friendlyetl-PKG: zero-code ETL framework with pipeline chaining, deduplication and validation
- Immigration-Data-Engineering: U.S. immigration data pipeline with PySpark, Hadoop HDFS and Airflow
- Hadoop-Connectors-Master: Hadoop connectors
- Top Data Engineering Blogs
- Big Data Project Architecture and Evolution
- Building a Real-Time Streaming Pipeline with Spark, Kafka and Cassandra
LinkedIn Top Voice (Data Engineering, Data Mining, Data Architecture) · HackerRank SQL Gold and Python Silver · PyPI Publisher · GitHub Pull Shark
