Delta Lake for Machine Learning Pipelines in AWS

Machine learning pipelines begin with data extraction – whether training or inference. After all, we need a dataset to begin any ML workflow. Most of us begin by querying OLTP/OLAP tables from an on-premises relational database, such as SQL Server. When our query completes, we save the results locally as CSV and then upload theContinue reading “Delta Lake for Machine Learning Pipelines in AWS”

How To Scope Out A Dataset From Scratch (Enterprise ML)

Every machine learning solution requires a dataset that encapsulates the business problem to be solved. A machine learning system will ingest this dataset, learn its complex patterns/relationships, and output a set of business predictions that help solve a specific business problem. This sounds great, but how do you acquire this dataset?

AI/ML Product Management Fundamentals

How do you build products that leverage machine learning? Machine learning is using data to answer valuable business questions. Answering these business questions should lead to the creation of tangible business value. This could be increased revenue, decreased costs, increased retention rate, increased operational efficiency, etc. Therefore, always focus on the business impact of artificial intelligence whenContinue reading “AI/ML Product Management Fundamentals”

Machine Learning Product Success Metrics

When you are building an AI/ML product, it’s paramount that you define clear success metrics from the beginning. These metrics will help guide the AI product development lifecycle and ensure that your team converges on the right product that solves business problems/user needs. There are two ways to assess AI/ML product success: 1) Business outcomesContinue reading “Machine Learning Product Success Metrics”

How To Identify Unknown Features In Machine Learning

What is a feature in machine learning? A feature is a measurable property or characteristic of an event you want to predict. But, what happens if you have missing or unknown features for the event you want to predict? What if these features are crucially important to make accurate predictions? Let’s look at a concreteContinue reading “How To Identify Unknown Features In Machine Learning”

Bias In Artificial Intelligence

You may have heard the term “bias” in artificial intelligence. It usually refers to machine learning algorithms that make biased predictions. Biased predictions are a sign of underperforming machine learning models that were not trained with the proper datasets. Most people know that the performance of a machine learning model is directly proportional to theContinue reading “Bias In Artificial Intelligence”

The Most Important Element Of AI Adoption

What is the most important element that will determine the success or failure of an AI/ML project? Most people, including technical professionals in the field, would think it’s the datasets: Quality, quantity, and a data engineering pipeline to produce them. This is because machine learning algorithms perform only as good as the data used toContinue reading “The Most Important Element Of AI Adoption”

The 3 Layers Of The AI Stack

“Should we build everything from scratch, use third-party machine learning services, or a combination of both?” When you identify AI/ML use cases for your company (or your company’s clients) that will lead to business value and ROI, you need to know the various implementation options. Every company is different: Each has its own business objectives,Continue reading “The 3 Layers Of The AI Stack”

3 Things You Need Before Getting ROI From AI/ML Projects

Everyone involved in the early stages of enterprise AI adoption wants to get ROI from AI/ML projects as fast as possible. We all know artificial intelligence is the future, and organizations are rushing in to capitalize on this world-changing technology before AI disruption makes them irrelevant in the marketplace. In a previous blog post, IContinue reading “3 Things You Need Before Getting ROI From AI/ML Projects”

3 Key Factors When Managing AI/ML Projects

What are three key factors to keep in mind when you are making 7-8 figure investment decisions for AI adoption and managing enterprise AI/ML projects? It’s not the machine learning models, ETL processes, containerization, or scalable deployments in production. It’s about the impact of AI adoption on the organization. Here are 3 key factors toContinue reading “3 Key Factors When Managing AI/ML Projects”