Join Visa as a Data Engineer supporting reporting and analytics, working with MS SQL, Hadoop, and ETL technologies in a fast-paced, purpose-driven environment.
Job Details
| Job Title | Data Engineer (Hive, Hadoop, ETL, MS SQL, Python/Java, 1-3 years) |
|---|---|
| Company | Visa |
| Location | Bangalore, India |
| Job Type | Full-time |
About Visa
Visa is a global leader in payments and technology, processing over 259 billion transactions across more than 200 countries and territories annually. With a mission to connect the world through secure and reliable payment solutions, Visa empowers individuals, businesses, and economies to thrive. As a Visa employee, you’ll make an impact in an organization that’s driven by purpose and focused on innovation and security in financial transactions.
Job Summary
As a Data Engineer, you’ll support Visa’s Verifi reporting and analytics team, working on data pipelines, ETL processes, and analytics solutions. Your work will involve developing, maintaining, and optimizing solutions for self-service reporting and data integration. With exposure to MS SQL Server, Hadoop, and ETL tools, you’ll help build scalable data solutions to empower Visa’s business users and stakeholders.
Key Responsibilities
- Data Engineering: Develop and maintain data pipelines and analytics solutions using MS SQL, Hadoop, and ETL technologies.
- Data Integration: Design and implement data integration solutions for reporting and analytics on relational databases (MS SQL Server).
- Collaboration: Work closely with the application and DBA teams to deliver high-quality data services.
- Data Model Design: Design scalable data warehouse solutions using MS SQL and Hadoop, ensuring high availability and low latency.
- Database Engineering: Implement high-availability solutions, replication, disaster recovery, and encryption to ensure secure and reliable data access.
- Data Analysis: Provide data analysis, validation, and support for Visa’s business units, helping them gain insights and make data-driven decisions.
- Automation: Integrate CI/CD tools like Jenkins and Redgate for automated deployment.
Qualifications
- Experience: 1-3 years of work experience in data engineering, preferably in a large-scale enterprise environment.
- Technical Skills:
- Hands-on experience with Hadoop, Hive, Spark, and MS SQL Server.
- Strong programming skills in Python, Java, or Scala.
- Expertise in writing complex SQL queries and implementing ETL processes.
- Experience with Wherescape RED or similar ETL tools.
- Familiarity with data modeling, data validation, and reporting.
- Automation & CI/CD: Knowledge of tools like Jenkins, Git, and Redgate for continuous integration and deployment.
- Problem-Solving: Strong analytical and troubleshooting skills, especially in high-availability environments.
- Collaboration: Ability to work effectively in cross-functional teams and influence senior leadership on engineering strategies.
Preferred Skills
- Experience with big data technologies such as Hadoop, Spark, and Hive.
- Exposure to Gen AI/ML and proof of concepts (POCs) in data science.
- Familiarity with Agile Release Management, governance, and planning.
Why Join Visa?
- Innovative Environment: Work with cutting-edge technologies in the payments and financial sectors.
- Global Impact: Play a key role in shaping secure, scalable, and innovative data solutions used worldwide.
- Career Growth: Visa offers strong opportunities for career advancement and development.
- Inclusive Culture: Visa is committed to diversity and inclusion, ensuring equal opportunity for all employees.
How to Apply
If you’re an experienced Data Engineer with a passion for scalable solutions and data-driven insights, apply now to join Visa and be part of a purpose-driven team transforming the financial industry.\
The Data Engineer position at Visa in Bangalore offers an exciting opportunity for professionals with 1–3 years of experience in data engineering, ETL processes, and big data technologies. Below is a detailed summary and preparation guide for this role:
Role Overview
As a Data Engineer at Visa, you will contribute to developing data pipelines, ETL solutions, and scalable data warehouse architectures. The role focuses on enabling self-service reporting and analytics for business users by leveraging modern data technologies such as Hadoop, Hive, and MS SQL, among others.
Key Responsibilities:
- Data Warehouse Development:
- Architect, develop, and maintain MS SQL databases for high SLA environments.
- Design scalable solutions for data warehouse implementations, including facts and dimensions modeling.
- ETL Development:
- Create data pipelines using Wherescape RED or similar ETL tools.
- Work on complex T-SQL scripts and integrate code with Redgate for automated deployment.
- Big Data Solutions:
- Design and develop data pipelines using technologies like Hadoop, Hive, and Spark.
- Engage in proof-of-concept work on emerging tools and platforms.
- Automation & Performance Optimization:
- Implement CI/CD pipelines, automated deployment processes, and system availability enhancements.
- Troubleshoot database issues, optimize performance, and ensure disaster recovery readiness.
- Collaboration:
- Work closely with application and DBA teams to meet delivery timelines and SLA requirements.
- Provide data validation and analysis for key business use cases.
Skills and Qualifications
Basic Qualifications:
- 1–3 years of experience in data engineering or related fields.
- Bachelor’s or Master’s degree in Computer Science, Information Science, or equivalent.
Technical Expertise:
- Programming: Proficiency in Python and Java (or Scala) for data processing tasks.
- Big Data: Experience with Hadoop, Hive, and Spark.
- SQL Expertise: Strong skills in SQL Server (2017/2019) and MySQL, with advanced SQL query writing capabilities.
- ETL Tools: Hands-on experience with Wherescape RED or equivalent tools.
- Scripting & Automation: Familiarity with Jenkins, Git, and CI/CD tools.
Bonus Skills:
- Experience in Gen AI/ML for proof-of-concepts.
- Understanding of high availability, disaster recovery options, and native SQL Server replication.
- Agile development practices and release management.
Preparation Tips for the Role
1. Brush Up on Core Skills:
- SQL Mastery: Practice writing advanced queries, including joins, CTEs, and window functions.
- Big Data Tools: Gain hands-on experience with Hive and Spark. Set up a small Hadoop cluster or use cloud-based big data services to experiment.
- ETL Workflows: Familiarize yourself with ETL processes, especially if you haven’t used Wherescape RED. Learn concepts like data extraction, transformation, and loading for large datasets.
2. Strengthen Programming Expertise:
- Work on Python libraries like Pandas and PySpark for data processing.
- Build mini-projects showcasing your ability to use Java/Scala for distributed computing tasks.
3. Understand Visa’s Domain:
- Research Visa’s products, particularly fraud prevention and dispute management solutions.
- Read about payment technology trends, such as transaction processing and data-driven risk management.
4. Prepare for Problem-Solving Questions:
- Practice solving real-world scenarios where you need to design data pipelines or troubleshoot database issues.
- Use platforms like HackerRank or LeetCode to practice SQL, Python, and Java problems.
5. Showcase Your Soft Skills:
- Be prepared to discuss past experiences working in cross-functional teams.
- Highlight situations where you identified risks and proposed solutions to mitigate them.
6. Stay Updated on Trends:
- Learn about advancements in Gen AI/ML for data engineering and analytics.
- Explore new features in SQL Server (2019) and Wherescape RED.
Why This Role is Exciting
- Global Impact: Work with Visa, a global leader in payments, and contribute to systems that support billions of transactions.
- Technology Stack: Gain experience with cutting-edge technologies, including Hadoop, Spark, and advanced ETL tools.
- Professional Growth: Learn from a highly experienced team and work on innovative data engineering projects with real-world applications.
