Putting a predictive model into production


Even after all these years of data science from 2010 to 2018, why is there no general framework for putting a predictive model into production?


Posted 2018-01-30T00:36:19.327

Reputation: 113

Question was closed 2018-02-17T19:01:24.253

1Wow, that's a broad question. In it's current form, it's probably impossible to answer - a narrower version could elicit some great responses, though. – Robert de Graaf – 2018-01-30T02:38:31.823



Depending on what exactly you mean by framework, I would argue that there is. Using a REST interface to serve a production model at inference time is pretty close to a general serving framework at this point.

However, there are a potentially infinite number of use cases that would diverge from this standard even if one categorically existed. Some mobile apps using image recognition models on personal data that the user doesn't want transmitted to the cloud are pushing the envelope of ways to compress formerly huge neural network architectures into ones that easily fit into mobile-sized memory, for example.

If you're talking software framework, it shouldn't be surprising that a field of programming practice (or, rather, plethora of fields) that find needs for a variety of languages and even ecosystems within languages would have difficulty forming a consensus around a single aporoach.

It's likely that deployment frameworks have yet to build in enough benefit to justify a reduction in general flexibility to justify their use.

Thomas Cleberg

Posted 2018-01-30T00:36:19.327

Reputation: 1 437