Why Instill AI exists

We aim to build tools to streamline the process of distilling the value of unstructured data across all stakeholders in the modern data stack, to ultimately benefit all-size organisations.

Ping-Lin Chang's github avatar

Published by

Ping-Lin Chang

on 1/16/2022

The theme of this tutorial

In this article, we are going to establish the thesis behind Instill AI’s mission.

We believe that ML/AI should be as easy to access as other general off-the-shelf cloud services in the software industry nowadays. Our faith comes from not only the technologies readiness but also the significance of having AI highly accessible.

AI is a fundamental building block for an automation system performing all sorts of human daily tasks. We can find use cases in autonomous driving, robotic vision, augmented reality, healthcare, smart manufacturing, smart agriculture, creative industries, etc. In essence, AI is the key to making a computer understand and extract the value of unstructured data.

#Our mission

To date, the industry still harnesses AI in a very inefficient way. Its implementation and deployment are extremely costly. Despite the emergence of new tools for building AI solutions, they are generally too complex, requiring a steep learning curve and multifunctional teams to use. In consequence, only large enterprises with abundant resources can successfully onboard and benefit from AI.

We aim to build tools to streamline the process of distilling the value of unstructured data across all stakeholders in the modern data stack, to ultimately benefit all-size organisations.

#The challenges of AI adoption

Deep Learning has achieved significant results in the last decade, since AlexNet breaking through the ImageNet challenge in 2012 and the emergence of many even more sophisticated architectures, VGG (2014), Inception (2014–2016), ResNet (2016), MobileNet (2017–2018), EifficentNet (2019–2020), just to name a few representative ones. We have had yet another exciting direction, Vision Transformer (ViT), inspired by the NLP field in 2020. With AI research pushing the limits and new models topping leaderboards every day, you might wonder: Isn’t AI already easy to build and access? Well, the answer is: Not quite.

In reality, building and maintaining an effective AI solution within the data stack of an organisation is surprisingly expensive with a lot of up-front development costs. It can consume millions and take at least a year from forming an AI team to deploying the first working AI model on production. In addition, AI models cannot deliver business value alone. An organisation will need to equip other functional teams, such as backend, infrastructure and data team, around the AI team. This results in low return on investment (ROI) and unavoidably long time-to-market of AI.

To be more elaborate, the challenges are mainly twofold:

#Maintenance and optimisation

While the status quo of AI algorithms still has much room to improve to achieve human-level performance, keeping an AI system to be constantly accurate in production requires continuous effort due to the nature of statistical data-driven algorithms. It might come as a surprise to most AI practitioners, i.e., deployed models will inevitably drift from the training data domain and need to be re-trained with the up-to-date production dataset and re-deployed to production on a regular basis.

A common issue among lab-level models is that they are not optimised for memory footprint and speed. This may cause deployment in production infeasible or the ultimate AI product performance-wise unusable at all. However, to have an optimised inference service on production with consistent high-speed performance is not trivial. An organisation needs to form a team consisting of infrastructure and backend engineers to take care of the production system requirements.

#Silo mentality due to a broken value chain

For running a successful AI project, an AI-capable organisation needs a number of different roles including AI/ML Engineers, AI/ML Researchers, Data Engineers and Data Analyst (it can also include Analytics Engineers, a new role that owns the end-to-end data stack). If the data flow is complex, it might even need Backend Engineers, Front-end Engineers, DevOps Engineers, and Site-Reliability Engineers to build and maintain the AI system end-to-end.

Despite the fact that the up-to-date Deep Learning frameworks have shown significant progress in usability since 2012, the tools are devised particularly for AI Engineers and AI Researchers who have specialised skill sets that are not available in other roles.

On the other hand, to successfully devise and train an AI model to solve production demands, AI Engineers and AI Researchers need to depend on Data Engineers and Data Scientists to collect production data and prepare training data beforehand. This means an organisation will need to maintain all different function teams, resulting in high communication barriers and cultural silos.

To make the long story short, existing tools mainly focus on model lifecycle management. They can accelerate model development cycles and shorten time-to-market. However, models alone cannot deliver the ultimate business value. Stakeholders in the value chain are thus disjoint. They use hybrid tools and speak in different languages, resulting in aggravating the silo mentality issue.

#What is on the table now?

The AI/ML industry and academia have persistently pushed solutions to tackle the challenges. Research in AI and Deep Learning has its own pace and is continuously developed. In addition, tools for MLOps and AutoML have been prosperously developed particularly for the current best practice of Software 2.0 and data-centric AI, such as InfuseAI PrimeHub, Iguazio, Spell, Databricks, Google Vertex and AWS SageMaker. Furthermore, open-source TensorRT and Apache TVM are also available for production model optimisation. As the technologies continuously evolve, we can expect to have more efficient and effective tool sets for maintenance and optimisation, resulting in less costly, more accurate and faster AI models in the near future.

#What is missing?

Until recently, most organisations still primarily relied on structured data for data analytics. Unstructured data, like image, video, text and audio data do not have a predefined easy-to-analyse format. In spite of IDC projections showing that 80% of worldwide data will be unstructured by 2025, organisations still can’t tap the value of unstructured data because a) most existing data tools are designed for structured data; b) tech stack silos due to fragmentation: emerging MLOps tools and AI solutions provide different proprietary frameworks. AI practitioners thus need to piece different frameworks together and integrate them with the existing data stack, adding no benefit to creation and deployment, resulting in inefficiency.

Despite the fact that the existing MLOps tools have effectively helped accelerate the ML model development, seamless integration of the AI tech stack and the modern data stack is still missing. The absence has slowed down AI adoption and broken the data value chain.

#What are we going to build?

We are a nimble team formed by members working for years in Computer Vision, Machine Learning, Deep Learning, large-scale database, and cloud-native applications/infrastructure. Our tools are built for the modern AI team to reduce team silo and decouple work dependency between different roles to increase work efficiency and capability to be self-service. Developers with various backgrounds can benefit from the tools in different ways:

  • AI/ML Engineers: automatic model optimization, simplified and managed model serving, and tools for production model monitoring
  • AI/ML Researchers: easier access to unstructured data for production experimentation and benchmarking
  • Data Engineers: low-code for integrating with various data sources and destinations, and easier data pipeline management
  • Data Scientists: richer insights from unstructured data to uncover unknown patterns and produce better analysis

Most importantly, we aim to bring AI into the modern data stack by standardising unstructured data ETL. Our tools are built within an open and maintainable framework, making it possible for communities to benefit and participate.

#Be a part of the journey

If you have read this far, it is likely that we share some experiences or thoughts in common. Please join our community, we’d love to exchange with you more ideas of unstructured data ETL, AI, and MLOps.

Instill Cloud is currently in open alpha, working very closely with early users to build the most effective tool for unstructured data infrastructure. Sign up for free today.

Last updated: 3/10/2024, 5:43:59 PM