Back to all jobs

Remote Big Data Engineer – Hadoop, Spark, Python & Cloud Pipeline Development (Full-Time, $28/Hour)

Work from home Full-time role Hiring
```html

Build the Future of Financial Data Engineering at arenaflex

Are you a passionate Big Data Engineer who thrives on architecting scalable data pipelines, mentoring high-performing development teams, and turning complex financial datasets into actionable insights? arenaflex is searching for a forward-thinking, technically exceptional Big Data Engineer to join our rapidly growing technology organization in Phoenix, USA. This is your opportunity to design and deliver innovative, real-time analytical solutions that power the financial products and services used by millions of customers worldwide.

At arenaflex, we believe technology is the engine that drives exceptional customer experiences. As a member of our diverse and collaborative tech group, you will engineer, code, and ship production-grade software that directly shapes how our clients interact with their finances in an increasingly digital world. You will work side-by-side with talented engineers in an open, supportive, and inclusive environment where your ideas are heard, your autonomy is respected, and you have the freedom to choose the best technologies to solve challenging, meaningful problems.

arenaflex is deeply committed to professional growth. We offer dedicated time and resources to help you keep your skills sharp, explore emerging technologies, and contribute to the broader engineering community through open-source projects. If you have a rebel-with-a-cause mindset, love pushing boundaries, and want to make a measurable impact in the financial technology space, find your place in technology with #TeamArenaflex.

What You Will Do – Key Responsibilities

Software Development & Engineering Excellence

  • Design, develop, and deploy high-quality, production-ready software using modern big data tools and frameworks such as Hadoop, Spark (Core, SQL, and PySpark), Hive, Kafka, and MapReduce.
  • Write clean, efficient, and maintainable code primarily in Core Java, Python, or Scala, applying industry best practices for software craftsmanship.
  • Actively participate in code reviews, automated testing, continuous integration, and continuous deployment (CI/CD) pipelines to ensure code quality and reliability.
  • Troubleshoot and resolve complex programming issues, identify code defects, and drive timely remediation.
  • Enable seamless deployment, monitoring, and support of software across test, integration, and production environments.
  • Automate solutions in test and production environments, and design applications that auto-scale based on real-time demand projections.
  • Develop and optimize advanced data pipelines for both batch and real-time data processing, handling massive volumes of structured and unstructured data.

Architecture, Design & Innovation

  • Apply visualization and analytical techniques to rapidly prototype ideas and communicate complex data flows.
  • Drive continuous improvement in code structure, performance, and quality through ongoing refactoring and architectural enhancements.
  • Author and maintain comprehensive technical and functional specifications, API documentation, and system processing flow diagrams.
  • Identify and champion opportunities to adopt innovative, emerging technologies that align with arenaflex's strategic roadmap.
  • Manage a specific platform, product, or dynamic resource pool assignment, adapting to evolving business needs and project demands.

Leadership & Team Collaboration

  • Lead and mentor a small team of engineers, inspiring them to reach their full potential while fostering a culture of innovation, accountability, and excellence.
  • Influence peers and cross-functional partners by introducing creative improvements, challenging conventional approaches, and demonstrating calculated risk-taking.
  • Serve as a core member of an Agile team, driving user story analysis, elaboration, design, development, testing, and build automation.
  • Collaborate with product managers, data scientists, and business stakeholders to deliver solutions that meet both technical and business requirements.

Minimum Qualifications

  • Bachelor's degree in Engineering, Computer Science, Data Systems, or a related technical field; OR a Master's degree in Computer Applications (MCA) or equivalent.
  • 3+ years of professional software development experience, including hands-on leadership of engineering teams and Scrum teams.
  • 3+ years of practical, production experience working with MapReduce, Hive, and Spark (Core, SQL, and PySpark).
  • Strong conceptual and applied understanding of Data Warehousing principles, dimensional modeling, and ETL processes.
  • Solid expertise in distributed computing environments and large-scale data architectures.
  • Hands-on programming experience in Core Java, Python, or Scala.
  • Mastery of Hadoop and Spark architecture, including internal working principles and performance tuning.
  • Proven ability to write and interpret complex SQL queries (Hive/PySpark DataFrames), optimize joins, and process massive datasets efficiently.
  • Experience with UNIX shell scripting for automation and operational tasks.
  • Demonstrated capability to analyze, design, develop, test, and deploy scalable system applications.
  • Strong analytical skills with the ability to document technical and functional specifications and trace system processing flows.

Preferred Qualifications

  • Working knowledge of cloud platforms such as GCP or AWS, including experience building microservices and elastic, scalable solutions.
  • 3+ years of experience designing and building real-time data streaming solutions using Kafka streams or message queuing systems.
  • Familiarity with version control and collaboration tools such as GitHub or Bitbucket, and experience using CI/CD pipelines.
  • Exposure to NoSQL databases including HBase, Couchbase, or MongoDB.
  • Knowledge of financial reporting environments, regulatory frameworks, or fintech data systems is a strong plus.
  • Excellent technical, analytical, and problem-solving aptitude.
  • Outstanding communication skills with the ability to translate complex technical concepts to non-technical audiences.
  • Exceptional project management and organizational skills with a track record of delivering on time and within scope.

Skills & Competencies for Success

  • Technical Mastery: Deep expertise in big data ecosystems, distributed systems, and modern programming languages.
  • Problem-Solving Mindset: Ability to break down ambiguous, complex problems into elegant, scalable solutions.
  • Collaborative Spirit: Strong team player who thrives in cross-functional, Agile environments.
  • Innovation Driven: Constantly explores new tools, frameworks, and approaches to improve outcomes.
  • Ownership & Accountability: Takes initiative, follows through, and delivers high-impact results with minimal supervision.
  • Adaptability: Comfortable shifting between deep technical work, strategic planning, and team leadership.

Career Growth & Learning Opportunities at arenaflex

At arenaflex, your growth is our priority. We invest in our engineers by providing dedicated time each quarter for professional development, conference attendance, certifications, and open-source contributions. Whether you aspire to become a Principal Engineer, an Engineering Manager, or a Solutions Architect, we offer clearly defined career ladders, internal mentorship programs, and leadership training to help you reach your goals. You'll gain exposure to cutting-edge financial technology, work on projects that genuinely impact millions of customers, and collaborate with some of the brightest minds in the industry.

Work Environment & Company Culture

arenaflex fosters a culture built on collaboration, inclusion, innovation, and accountability. We believe diverse perspectives drive better outcomes, and we empower every team member to bring their authentic self to work. Our engineers enjoy a flexible, supportive environment that values work-life balance, encourages continuous learning, and rewards bold thinking. You'll join a fast-paced, entrepreneurial team that moves quickly, ships often, and celebrates both individual and collective wins.

Compensation, Perks & Benefits

This is a full-time position offering a competitive hourly rate of $28/hour, equivalent to approximately $58,240 annually based on standard 40-hour work weeks. In addition to base compensation, arenaflex offers a comprehensive benefits package designed to support your financial, physical, and emotional well-being:

  • Comprehensive Health Coverage: Medical, dental, and vision insurance plans for you and your dependents.
  • Retirement Savings: 401(k) plan with company match to help you build long-term financial security.
  • Paid Time Off: Generous vacation, holiday, and personal days so you can recharge and stay balanced.
  • Wellness Programs: Access to mental health resources, fitness reimbursements, and wellness incentives.
  • Learning Stipend: Annual budget for certifications, courses, books, and conference attendance.
  • Remote Flexibility: Work from a flexible arrangement that supports productivity and personal commitments.
  • Rewards & Recognition: Performance-based bonuses, peer recognition programs, and milestone celebrations.
  • Global Opportunities: Exposure to international projects, cross-functional collaboration, and career mobility across regions.

Equal Opportunity Employment

arenaflex is proud to be an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. Employment decisions are made based on qualifications, merit, and business needs, without regard to race, color, religion, gender, sexual orientation, national origin, age, disability, veteran status, or any other protected characteristic. Offers of employment are contingent upon the successful completion of a background verification check, in compliance with applicable laws and regulations.

Ready to Engineer the Future of Finance with arenaflex?

If you are a driven Big Data Engineer ready to tackle complex challenges, lead innovative projects, and grow your career at a company that genuinely values your contributions, we want to hear from you. This is more than a job — it's an opportunity to shape the future of financial technology, work with world-class talent, and build solutions that touch millions of lives every day. Don't miss your chance to become a key player on #TeamArenaflex. Apply today and take the next big step in your engineering career.

``` Apply for this job

More remote roles to explore

Experienced Remote Data Entry Specialist – Financial Services Operations & Information Accuracy

Work from home Full-time role

Remote Customer Service Representative – Flexible Home‑Based Role with arenaflex, Global E‑Commerce & Technology Leader

Work from home Full-time role

Remote Customer Support Representative – arenaflex Home‑Based Service Role – $25/hr, Flexible Schedule, Career Growth Opportunities

Work from home Full-time role

Part-Time Remote Data Entry Specialist – Competitive Hourly Rate – Join arenaflex’s Dynamic Team

Work from home Full-time role

Remote Technical Customer Service Support Agent – Troubleshooting, Device & Application Assistance for arenaflex’s Global E‑Commerce Platform

Work from home Full-time role

Remote Data Entry Specialist – Home‑Based Role Supporting arenaflex’s Global Airline Operations

Work from home Full-time role

Remote arenaflex Data Entry Specialist – Full‑Time, $26/hr, Travel Management & Business Development Focus

Work from home Full-time role

Remote Customer Support Specialist – Home‑Based E‑Commerce Service Representative for arenaflex

Work from home Full-time role

Remote Marketplace Data Entry Specialist – E-Commerce Product Information & Quality Assurance (Work From Home | $25/Hour)

Work from home Full-time role

Part‑Time Customer Service & Data Entry Specialist – $25/Hour – arenaflex Aviation Operations

Work from home Full-time role

Experienced Tier 2 Technical Support Analyst – Voice/Chat/Email Support Specialist at arenaflex

Work from home Full-time role

Junior Procurement Analyst

Work from home Full-time role

Netflix Tagger

Work from home Full-time role

Associate Game Designer, Narrative – Temp | Immortal | Remote

Work from home Full-time role

Associate Director, Pharmacovigilance Operations

Work from home Full-time role

Experienced Remote Data Entry Research Panelist – Flexible Work Arrangements in arenaflex's Florida Office

Work from home Full-time role

AF495 VS1: Multidisciplinary Capstone (Fall 2026)

Work from home Full-time role

Program Manager, Environmental Health & Emergency Preparedness

Work from home Full-time role

APTPUO - Fall 2026 - EDU5261 - DA10 - Curriculum Design for Health Professions Education

Work from home Full-time role

Lead Principal Consultant - Remote

Work from home Full-time role