Data Engineer
Remote
Full Time
Experienced
Who We Are
MAS Global is a leader in digital engineering services, specializing in custom software engineering, cloud modernization, and expanding our leadership in Data and AI-driven solutions. With onshore and nearshore teams in the same time zones, we deliver innovative and efficient solutions that streamline digital outcomes for midsize and global brands like Johnson Controls, Dell, JPMorgan Chase, and Bloomberg.
Headquartered in Tampa, Florida, with a nearshore office in Medellín, Colombia, and teams across the US and LATAM, MAS has been recognized five times by Inc. 5000 as one of the fastest-growing companies in the United States. As a 100% women-owned and founder-led company, we also have a foundation, MAS Future, dedicated to impacting 1M women and Latinos through tech education and job opportunities.
At MAS, a certified Great Place to Work, we are shaping the future of digital engineering through innovation, collaborative partnerships, and purpose-driven impact.
Key Responsibilities:
- Design, develop, and manage scalable data pipelines using advanced technologies like Java, Apache Spark, and AWS to process large-scale data and ensure seamless data integration and transformation.
- Optimize job execution and performance for both real-time and batch data workflows, ensuring efficient processing and minimal downtime.
- Troubleshoot and resolve production issues to maintain system reliability and performance across platforms.
- Implement and manage event-driven architectures using AWS services (SNS, SQS, Lambda, EventBridge) to deliver processed data to downstream applications.
- Perform advanced data validation, reconciliation checks, and error tracking mechanisms to ensure data accuracy, integrity, and security.
- Develop complex SQL queries for data manipulation, including deduplication, filtering, and encryption to secure sensitive financial data.
- Collaborate with cross-functional teams to design and deliver data-driven solutions that meet business needs and align with organizational goals.
- Manage AWS resources and deploy infrastructure-as-code using Terraform to maintain consistent environments across development, staging, and production.
- Maintain and manage operational storage in Cassandra DB and Hive tables for large-scale querying and error logging.
- Develop and maintain automated workflows using Shell scripts, Control-M, and AWS EMR to enable smooth pipeline execution and job scheduling.
- Utilize Snowflake as the central data warehouse for analytics, integrating structured and unstructured data into a unified reporting framework.
- Develop and maintain Java-based test suites using JUnit to validate pipeline integrity and conduct unit and integration testing.
- Integrate machine learning models into data pipelines to enhance customer experiences with personalized recommendations.
- Monitor and troubleshoot distributed systems, including Spark job failures, Lambda timeouts, and performance issues.
- Enforce data governance practices to maintain data security and prevent unauthorized access or data leaks.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Strong experience in Java, Apache Spark, and other big data technologies.
- Proficient in AWS services (SNS, SQS, Lambda, EventBridge, EMR) and deploying applications using Terraform.
- Expertise in SQL and experience with databases like Cassandra, Hive, and Snowflake.
- Familiarity with machine learning concepts and integration into data pipelines.
- Experience with CI/CD automation and version control systems (e.g., Git).
- Strong understanding of distributed systems, data governance, and security best practices.
- Familiar with tools like Splunk and Dynatrace for monitoring and troubleshooting.
- Excellent problem-solving, communication, and collaboration skills.
- Experience with Scala, Python, or other programming languages.
- Familiarity with financial data processing and transaction systems.
- Experience with testing frameworks such as Mockito for unit testing.
Apply for this position
Required*