Factmata is looking for an experienced and creative data engineer to help us solve the problem of misinformation online. At Factmata, we are building systems to automatically classify the credibility, quality, safety and reliability of online information, using state-of-the-art machine learning algorithms paired with human expertise.
We’re looking for someone who will have a key role in building our core product as we bring it to market. You'll be responsible for adding new features to our data pipeline, connecting it to our machine learning systems, databases and external services. You will also be responsible for creating and maintaining our B2B APIs, to enable our clients to push and pull data from our data pipeline.
Current stack: Python 3, PostgreSQL, RabbitMQ, CircleCI, Docker, Kubernetes, AWS
What you'll be doing
- Develop data and model storage systems
- Coordinate with both the business product and user product teams to ensure high quality engineering in an agile environment
- Scale and maintain our message-based data processing pipeline
- Extend and build upon our existing B2B APIs
- Develop web scraping architecture
- Manage integrations with other platforms and products
What we're looking for
- Proactive and positive attitude with ability to own projects and take work into your own hands
- Passionate about writing clean, well tested, and maintainable code
- PostgreSQL (or MySQL) experience
- 5+ years work experience
- Extensive Python experience
- Experience with distributed systems
- Experience with Docker
- Experience developing distributed microservices in Python
Bonus points for experience with:
- Building complex data processing pipelines
- Building scalable REST APIs
- Experience with CI tools such as CircleCI
- Real time distributed systems processing
- Data pipelines that can handle >1m URLs per hour
Joining the Factmata family represents an unprecedented opportunity to be part of a team with an outstanding purpose and the rare potential to do good in the world. We hire strongly for our values.
- Deliver results for our users.
- Do the basics.
- In facts we trust.
- Team sport.
- Be candid.
- Think Big!
- Prioritise growth.
- Show humility.
If you aren't completely confident that you fit our exact criteria, please get in touch immediately. Humility is a wonderful thing - we're at least as interested in character as in talent. Factmata is an environment you will learn in and be challenged, develop and grow as a person, build phenomenal technology, be given limitless opportunities to innovate and research, given autonomy, and connected with some of the brightest minds to help you do your work