PDF4PRO ⚡AMP

Modern search engine that looking for books and documents around the web

Example: stock market

Hidden Technical Debt in Machine Learning Systems - NIPS

Hidden Technical debt in Machine Learning SystemsD. Sculley, Gary Holt, Daniel Golovin, Eugene Davydov, Ebner, Vinay Chaudhary, Michael Young, Jean-Franc ois Crespo, Dan Learning offers a fantastically powerful toolkit for building useful com-plex prediction Systems quickly. This paper argues it is dangerous to think ofthese quick wins as coming for free. Using the software engineering frameworkoftechnical debt , we find it is common to incur massive ongoing maintenancecosts in real-world ML Systems . We explore several ML-specific risk factors toaccount for in system design. These include boundary erosion, entanglement, Hidden feedback loops, undeclared consumers, data dependencies, configurationissues, changes in the external world, and a variety of system -level IntroductionAs the Machine Learning (ML) community continues to accumulate years of experience with livesystems, a wide-spread and uncomfortable trend has emerged: developing and deploying ML sys-tems is relatively fast and cheap, but maintaining them overtime is difficult and dichotomy can be understood through the lens oftechnical debt , a metaphor introduced byWard Cunningham in 1992 to help reason about the long term costs incurred by moving quickly insoftware engineering.

the absence of barriers, engineers will naturally use the most convenient signal at hand, especially ... For example, rather than allowing a semantic mapping of words to topic clusters to change over time, it might be reasonable to create a frozen version of this mapping and use it until such a time as an updated version has been fully vetted ...

Loading..

Tags:

  System, Machine, Technical, Barriers, Learning, Debt, Hidden, Semantics, Hidden technical debt in machine learning systems

Information

Domain:

Source:

Link to this page:

Please notify us if you found a problem with this document:

Spam in document Broken preview Other abuse

Transcription of Hidden Technical Debt in Machine Learning Systems - NIPS

Related search queries