CareerRiver

Data Engineer - Senior Consultant level

Visa · San Francisco Bay Area

📍 US - Foster City, CAvia workday
Apply on company site ↗
CareerRiver pulls this listing straight from the employer's hiring system — no recruiter middleman, no reposts. Applying takes you directly to Visa.
About Us Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you. Job Description We’re building Visa’s next-generation GenAI Platform - the intelligent data and orchestration foundation powering AI applications, copilots, semantic search, and agentic systems across the enterprise and eventually for Visa clients globally. As a Data Engineer on the GenAI Platforms team, you will help architect and scale the data infrastructure that powers enterprise AI systems at global scale. This is not a traditional data engineering role focused only on pipelines and warehousing. You will work on AI-native data systems including retrieval infrastructure, vector indexing, semantic knowledge platforms, real-time context pipelines, orchestration data flows, and intelligent data services that enable large language models and AI agents to operate securely and effectively across enterprise environments. You’ll partner with software engineers, applied scientists, product teams, and platform architects to build highly scalable, production-grade systems that transform enterprise data into intelligent, context-aware AI experiences. This role is ideal for engineers who enjoy: Building large-scale AI and data platforms from the ground up Solving complex distributed systems and data retrieval challenges Designing intelligent knowledge and context systems for LLMs and agents Working across streaming systems, APIs, orchestration layers, and cloud-native infrastructure Operationalizing GenAI systems in secure enterprise environments You’ll help define how enterprise AI systems access, retrieve, reason over, and operationalize data across one of the world’s most trusted technology platforms. What You’ll Build Enterprise-scale retrieval and knowledge systems powering GenAI applications and AI agents Real-time and batch data pipelines supporting semantic search, embeddings, RAG, and orchestration workflows Intelligent context and indexing systems integrating structured and unstructured enterprise data AI-ready data infrastructure enabling scalable LLM applications and workflow automation Distributed streaming and event-driven architectures supporting AI-native applications Observability, evaluation, and governance systems for production AI data platforms The Work Itself Design and build scalable data platforms supporting LLM applications, AI agents, semantic search, and retrieval-augmented generation (RAG) Develop high-throughput real-time and batch data pipelines integrating enterprise systems, APIs, documents, events, and knowledge sources Build vector indexing, embedding pipelines, semantic retrieval systems, and intelligent context management frameworks Engineer backend services and APIs enabling orchestration workflows, AI tool integrations, and enterprise automation use cases Develop scalable data ingestion and transformation frameworks for structured and unstructured enterprise data Optimize performance, reliability, latency, and scalability of distributed AI data systems operating at enterprise scale Implement observability, lineage, monitoring, and evaluation frameworks for AI-powered data platforms Partner with product managers, software engineers, data scientists, and platform teams to deliver secure, production-grade AI capabilities Contribute reusable frameworks, platform tooling, and engineering best practices accelerating enterprise GenAI adoption Explore emerging technologies across GenAI infrastructure, orchestration systems, vector databases, and cloud-native data platforms This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager. Qualifications Basic Qualifications:   ·                5+ years of relevant work experience with a bachelor’s degree -or- At least 2 years of work experience with an Advanced degree (e.g., Masters, MBA, JD, MD) -or- 0 years of work experience with a PhD.   Preferred Qualifications:   ·                Four (4) years of experience solving data problems using data technologies (e.g., Hadoop, Hive, Kafka, Redis, NoSQL, RDBMS).  ·                Experience building enterprise GenAI platforms, semantic search systems, or AI data infrastructure ·                Experience with vector databases, embedding pipelines, retrieval optimization, or knowledge graph systems Experience implementing observability, lineage, evaluation, and governance frameworks for AI-enabled data systems ·                Familiarity with cloud-native AI infrastructure and scalable ML/data platform architectures ·                Exposure to payments, fintech, or highly regulated enterprise environments with stringent security and reliability requirements The Skills You Bring AI-Native Data Engineering Experience building data systems supporting LLM applications, RAG architectures, semantic retrieval, embeddings, vector databases, or AI orchestration workflows. Distributed Data Systems Strong expertise designing scalable distributed systems, streaming architectures, real-time pipelines, and large-scale data processing platforms. Retrieval & Knowledge Infrastructure Experience building semantic indexing systems, intelligent retrieval pipelines, metadata enrichment systems, or enterprise knowledge platforms. Real-Time Data Engineering Experience developing reliable event-driven and streaming systems using technologies such as Kafka, Spark, Flink, Hadoop, or similar large-scale pro

More San Francisco Bay Area jobs

San Francisco Bay Area jobs · Browse all locations