Experience in Data Ingestion and integration from various sources and experience building automated ingestion pipelines using AWSExperience in Data cleaning, processing and transformation for unstructured and semi-structured dataExperience preparing data for AI usage and experience with data profiling/quality—identify data gaps and inconsistencies.Tools - Strong Python, ETL libraries, SQLs, Docker/Kubernetes, Experience with some AWS Data/Pipeline Services, some exposure to NLP processing, experience with one vector DBSome Understanding of NLP processing - parsing, chunking, splitting, and tokenizationSome understanding of vector databases and embeddingAny experience working with a graph database is a plus
