Software engineering for better data science project experience

 Despite alarm being raised over five years ago, data science projects still regularly fail and on average show little return on investment. In this talk, we will:

  • discuss the data science lifecycle and focus on how the data preparation and feature engineering portion of the lifecycle contributes to the failures (Tina).
  • We will then discuss on how software engineering can help mitigate some of these issues (Andrew).
  • We will close by discussing what type of software products that data scientists are currently using for feature engineering and machine lifecycle ( Andrew)
  • Q&A (Tina & Andrew)