About Affiliate.com

Affiliate.com is a data and technology company that is revolutionizing the digital commerce ecosystem. We help power the social and affiliate commerce activities for thousands of publishers, including AI businesses, content sites, shopping sites, extensions, creator platforms and more. Affiliate.com integrates with every major affiliate network and over 20,000 merchants to help our publisher clients promote over 1 billion products around the world.

Affiliate.com’s founders have collectively achieved over 15 exits as operators and investors, and have deep operational experience in e-commerce, affiliate and performance marketing, and ad tech.

The Opportunity

As Affiliate.com continues to grow, we are seeking a dynamic and results-driven Senior Search & Data Platform Engineer to take ownership of our massive affiliate product dataset containing over 1 billion products. You will architect and build the systems that ingest, normalize, and distribute this data to power our platform offerings for publishers around the world.

You will be responsible for building robust data pipelines that pull feeds from multiple merchants and affiliate networks, normalize disparate data formats, and prepare the data for distribution through our search platforms and APIs.

In addition, you will:

• Architect, build, and take end-to-end ownership of the data pipelines that ingest, normalize, and index over 1 billion products from hundreds of thousands of affiliate and merchant feeds.
• Own and operate our large-scale search infrastructure on AWS, ensuring high availability, performance, and scalability for our customer-facing APIs.
• Design and implement advanced search features, including hybrid (fulltext + vector) search, to significantly improve the relevance and performance of our OpenSearch-powered services.
• Lead the development of new AI-powered features, from initial design and model selection to production deployment on AWS.
• Apply advanced NLP and machine learning techniques to solve complex data normalization, product categorization, and data enrichment challenges at scale.
• Manage the full MLOps lifecycle on AWS SageMaker, including deploying, fine-tuning, and monitoring the models that power our search and data enrichment services.
• Maintain and strategically evolve our entire data platform, including services written in Python and C/C++ and Cython, and search systems running on AWS OpenSearch and Manticore Search.
• Collaborate with the product team to translate business requirements into technical solutions and drive the future roadmap of our data platform.

While this a remote position, you must overlap with our US-based team for at least five hours per day. The ideal candidate is a self-starter with a strong background in the affiliate, creator and/or AI industries.

What You Will Bring

Data Engineering:

• 5+ years of professional experience in data engineering or a similar role, with a demonstrable track record of designing and operating complex, large-scale data systems
• 5+ years of experience building and maintaining large-scale data pipelines and ETL systems
• Expert-level proficiency in Python for data engineering and automation.
• Experience with Python technologies such as WSGI or SQLAlchemy
• Professional proficiency in C/C++ and Cython for maintaining and debugging existing data ingestion systems
• Deep understanding of data normalization techniques and experience processing disparate data formats (CSV, JSON, XML)
• Experience with FTP/SFTP protocols and automated file transfer systems
• Deep, hands-on experience architecting and managing data-intensive applications on AWS, using a combination of services like S3, Lambda, ECS, OpenSearch, and SageMaker
• Proven experience managing and optimizing at least one large-scale search engine (e.g., OpenSearch, Elasticsearch) with billions of documents
• Proficiency in database technologies such as SQL, including database design, querying, and optimization
• Knowledge of containerization technologies such as Docker
• CI/CD Experience

Machine Learning & AI:

• Strong foundation in machine learning concepts and practical experience deploying ML models in production
• Demonstrable experience applying NLP techniques (e.g., text normalization, entity extraction) to solve real-world data quality problems and search optimization
• Hands-on experience with the MLOps lifecycle, specifically deploying and managing machine learning models in a production environment using AWS SageMaker. Familiarity with model fine-tuning and training workflows
• Experience with ML frameworks (PyTorch, TensorFlow) and model serving platforms
• Knowledge of recommendation systems and their implementation at scale

Search & Data Platform:

• Experience building and optimizing search systems handling 1B+ records
• Understanding of hybrid search techniques combining keyword and vector search
• Experience with search relevance tuning and query optimization
• Knowledge of distributed computing and data sharding strategies

Additional Qualifications:

• Specific, demonstrable experience implementing hybrid (fulltext + vector) search in AWS OpenSearch
• Direct experience with Manticore Search
• Proficiency with Infrastructure as Code (IaC) tools like Terraform
• Experience maintaining and gradually modernizing legacy systems
• An independent self-starter who loves taking initiative and seeing things through from conception to completion with a large amount of autonomy.
• An excellent communicator, fluent in both verbal and written English, with the ability to explain, defend, and convince a wide cross-section of stakeholders about your ideas.
• Prior experience in the affiliate marketing, e-commerce, or creator economy industries. Familiarity with affiliate networks (Impact, CJ, ShareASale, etc.) and their data formats
• Ability to thrive in a very fast-paced startup environment.
• Comfortable leading projects with internal and external teams, rolling up your sleeves, and digging into the details yourself.
• The idea of being part of a fast-growing SaaS company at the forefront of innovation excites you.
• Happy working on tasks of all sizes - from small bug fixes and enhancements to large features/rewrites
• Presenting regular updates to senior leadership on progress and results
• Bachelor’s degree in Computer Science, Engineering, or related field
• Bonus if you have experience in Ecommerce and/or building Marketing Tech

Additional Information:

This is a remote position. Competitive salary. US / Canada candidates only.

Benefits:

• Health, Dental and Vision (US based candidates)
• Paid time off plus Federal Holidays