Jungle Scout case study: Kedro, Airflow, and MLFlow use on production code

  • Model training: We restructured our models with Kedro, which allowed us to build data pipelines that were testable and could run in parallel.
  • Scheduling: We used Airflow to help schedule, parallelize, and monitor model training jobs.
  • Model Review: We built a custom model review and promotion app based on Dash. This allowed us to quickly review several models across multiple marketplaces with confidence.
Architecture Diagram

“As we onboard new hires, they’re onboarded onto Kedro as well. It’s been faster than we were expecting for our hires to learn Kedro and add value with the tool.”

Adapting the use of Jupyter

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Jungle Scout Engineering

Jungle Scout Engineering

We are Jungle Scout. Our mission is to provide powerful data and resources to help entrepreneurs and brands grow successful businesses on Amazon