Amazon SageMaker Integrations

To develop AI solutions, engineers must have a resilient, open, repeatable engineering approach to ensure quality and agility. These efforts have not been able to address the challenges of today's complex environment, which is filled with a variety of tools and rapidly changing data. Platform for collaborative development that automates the control and development of AI applications across multiple persons. To predict customer behavior in real-time, and at scale, we can derive hyper-detailed customer profiles using enterprise data. AI-powered models that can continuously learn and achieve clearly defined business results. Allows organizations to demonstrate compliance with applicable rules and regulations. CognitiveScale's Cortex AI Platform is designed to address enterprise AI use cases using modular platform offerings. Customers use and leverage its capabilities in microservices as part of their enterprise AI initiatives.

Generative AI has a profound impact on virtually every industry. It opens up new opportunities for creative workers and knowledge to solve the world's most pressing problems. NVIDIA is empowering generative AI with a powerful suite of cloud services, pretrained foundation models, cutting-edge frameworks and optimized inference engines. NVIDIA AI Foundations is an array of cloud services that enable customization across use cases in areas like text (NVIDIA NeMo™, NVIDIA Picasso), or biology (NVIDIA BIONeMo™. Enjoy the full potential of NeMo, Picasso and BioNeMo cloud-based services powered by NVIDIA DGX™ Cloud, an AI supercomputer. Marketing copy, storyline creation and global translation in many different languages. News, email, meeting minutes and information synthesis.

Optimize ML models with real-time training metrics capture and alerting when anomalies are detected. To reduce the time and costs of training ML models, stop training when the desired accuracy has been achieved. To continuously improve resource utilization, automatically profile and monitor the system's resource utilization. Amazon SageMaker Debugger reduces troubleshooting time from days to minutes. It automatically detects and alerts you when there are common errors in training, such as too large or too small gradient values. You can view alerts in Amazon SageMaker Studio, or configure them through Amazon CloudWatch. The SageMaker Debugger SDK allows you to automatically detect new types of model-specific errors like data sampling, hyperparameter value, and out-of bound values.

Amazon SageMaker Model training reduces the time and costs of training and tuning machine learning (ML), models at scale, without the need for infrastructure management. SageMaker automatically scales infrastructure up or down from one to thousands of GPUs. This allows you to take advantage of the most performant ML compute infrastructure available. You can control your training costs better because you only pay for what you use. SageMaker distributed libraries can automatically split large models across AWS GPU instances. You can also use third-party libraries like DeepSpeed, Horovod or Megatron to speed up deep learning models. You can efficiently manage your system resources using a variety of GPUs and CPUs, including P4d.24xl instances. These are the fastest training instances available in the cloud. Simply specify the location of the data and indicate the type of SageMaker instances to get started.

Amazon SageMaker offers all the tools and libraries needed to build ML models. It allows you to iteratively test different algorithms and evaluate their accuracy to determine the best one for you. Amazon SageMaker allows you to choose from over 15 algorithms that have been optimized for SageMaker. You can also access over 150 pre-built models available from popular model zoos with just a few clicks. SageMaker offers a variety model-building tools, including RStudio and Amazon SageMaker Studio Notebooks. These allow you to run ML models on a small scale and view reports on their performance. This allows you to create high-quality working prototypes. Amazon SageMaker Studio Notebooks make it easier to build ML models and collaborate with your team. Amazon SageMaker Studio notebooks allow you to start working in seconds with Jupyter notebooks. Amazon SageMaker allows for one-click sharing of notebooks.

Amazon SageMaker Studio (IDE) is an integrated development environment that allows you to access purpose-built tools to execute all steps of machine learning (ML). This includes preparing data, building, training and deploying your models. It can improve data science team productivity up to 10x. Quickly upload data, create notebooks, tune models, adjust experiments, collaborate within your organization, and then deploy models to production without leaving SageMaker Studio. All ML development tasks can be performed in one web-based interface, including preparing raw data and monitoring ML models. You can quickly move between the various stages of the ML development lifecycle to fine-tune models. SageMaker Studio allows you to replay training experiments, tune model features, and other inputs, and then compare the results.

Amazon SageMaker Studio Lab provides a free environment for machine learning (ML), which includes storage up to 15GB and security. Anyone can use it to learn and experiment with ML. You only need a valid email address to get started. You don't have to set up infrastructure, manage access or even sign-up for an AWS account. SageMaker Studio Lab enables model building via GitHub integration. It comes preconfigured and includes the most popular ML tools and frameworks to get you started right away. SageMaker Studio Lab automatically saves all your work, so you don’t have to restart between sessions. It's as simple as closing your computer and returning later. Machine learning development environment free of charge that offers computing, storage, security, and the ability to learn and experiment using ML. Integration with GitHub and preconfigured to work immediately with the most popular ML frameworks, tools, and libraries.

Amazon SageMaker Feature Store can be used to store, share and manage features for machine-learning (ML) models. Features are inputs to machine learning models that are used for training and inference. In an example, features might include song ratings, listening time, and listener demographics. Multiple teams may use the same features repeatedly, so it is important to ensure that the feature quality is high-quality. It can be difficult to keep the feature stores synchronized when features are used to train models offline in batches. SageMaker Feature Store is a secure and unified place for feature use throughout the ML lifecycle. To encourage feature reuse across ML applications, you can store, share, and manage ML-model features for training and inference. Any data source, streaming or batch, can be used to import features, such as application logs and service logs, clickstreams and sensors, etc.

Amazon SageMaker Data Wrangler cuts down the time it takes for data preparation and aggregation for machine learning (ML). This reduces the time taken from weeks to minutes. SageMaker Data Wrangler makes it easy to simplify the process of data preparation. It also allows you to complete every step of the data preparation workflow (including data exploration, cleansing, visualization, and scaling) using a single visual interface. SQL can be used to quickly select the data you need from a variety of data sources. The Data Quality and Insights Report can be used to automatically check data quality and detect anomalies such as duplicate rows or target leakage. SageMaker Data Wrangler has over 300 built-in data transforms that allow you to quickly transform data without having to write any code. After you've completed your data preparation workflow you can scale it up to your full datasets with SageMaker data processing jobs. You can also train, tune and deploy models using SageMaker data processing jobs.

Amazon SageMaker Canvas provides business analysts with a visual interface to help them generate accurate ML predictions. They don't need any ML experience nor to write a single line code. A visual interface that allows users to connect, prepare, analyze and explore data in order to build ML models and generate accurate predictions. Automate the creation of ML models in just a few clicks. By sharing, reviewing, updating, and revising ML models across tools, you can increase collaboration between data scientists and business analysts. Import ML models anywhere and instantly generate predictions in Amazon SageMaker Canvas. Amazon SageMaker Canvas allows you to import data from different sources, select the values you wish to predict, prepare and explore data, then quickly and easily build ML models. The model can then be analyzed and used to make accurate predictions.

SageMaker Edge Agent allows for you to capture metadata and data based on triggers you set. This allows you to retrain existing models with real-world data, or create new models. This data can also be used for your own analysis such as model drift analysis. There are three options available for deployment. GGv2 (size 100MB) is an integrated AWS IoT deployment method. SageMaker Edge has a smaller, built-in deployment option for customers with limited device capacities. Customers who prefer a third-party deployment mechanism can plug into our user flow. Amazon SageMaker Edge Manager offers a dashboard that allows you to see the performance of all models across your fleet. The dashboard allows you to visually assess your fleet health and identify problematic models using a dashboard within the console.

Amazon SageMaker Clarify is a machine learning (ML), development tool that provides purpose-built tools to help them gain more insight into their ML training data. SageMaker Clarify measures and detects potential bias using a variety metrics so that ML developers can address bias and explain model predictions. SageMaker Clarify detects potential bias in data preparation, model training, and in your model. You can, for example, check for bias due to age in your data or in your model. A detailed report will quantify the different types of possible bias. SageMaker Clarify also offers feature importance scores that allow you to explain how SageMaker Clarify makes predictions and generates explainability reports in bulk. These reports can be used to support internal or customer presentations and to identify potential problems with your model.

Amazon SageMaker JumpStart can help you speed up your machine learning (ML). SageMaker JumpStart gives you access to pre-trained foundation models, pre-trained algorithms, and built-in algorithms to help you with tasks like article summarization or image generation. You can also access prebuilt solutions to common problems. You can also share ML artifacts within your organization, including notebooks and ML models, to speed up ML model building. SageMaker JumpStart offers hundreds of pre-trained models from model hubs such as TensorFlow Hub and PyTorch Hub. SageMaker Python SDK allows you to access the built-in algorithms. The built-in algorithms can be used to perform common ML tasks such as data classifications (images, text, tabular), and sentiment analysis.

Amazon SageMaker Autopilot takes out the tedious work of building ML models. SageMaker Autopilot simply needs a tabular data set and the target column to predict. It will then automatically search for the best model by using different solutions. The model can then be directly deployed to production in one click. You can also iterate on the suggested solutions to further improve its quality. Even if you don't have the correct data, Amazon SageMaker Autopilot can still be used. SageMaker Autopilot fills in missing data, provides statistical insights on columns in your dataset, extracts information from non-numeric column, such as date/time information from timestamps, and automatically fills in any gaps.

Amazon SageMaker Model Monitor allows you to select the data you want to monitor and analyze, without having to write any code. SageMaker Model monitor lets you choose data from a variety of options, such as prediction output. It also captures metadata such a timestamp, model name and endpoint so that you can analyze model predictions based upon the metadata. In the case of high volume real time predictions, you can specify the sampling rate as a percentage. The data is stored in an Amazon S3 bucket. This data can be encrypted, configured fine-grained security and defined data retention policies. Access control mechanisms can be implemented for secure access. Amazon SageMaker Model Monitor provides built-in analysis, in the form statistical rules, to detect data drifts and improve model quality. You can also create custom rules and set thresholds for each one.

Amazon SageMaker Pipelines allows you to create ML workflows using a simple Python SDK. Then visualize and manage your workflow with Amazon SageMaker Studio. SageMaker Pipelines allows you to be more efficient and scale faster. You can store and reuse the workflow steps that you create. Built-in templates make it easy to quickly get started in CI/CD in your machine learning environment. Many customers have hundreds upon hundreds of workflows that each use a different version. SageMaker Pipelines model registry allows you to track all versions of the model in one central repository. This makes it easy to choose the right model to deploy based on your business needs. SageMaker Studio can be used to browse and discover models. Or, you can access them via the SageMaker Python SDK.

Amazon SageMaker makes it easy for you to deploy ML models to make predictions (also called inference) at the best price and performance for your use case. It offers a wide range of ML infrastructure options and model deployment options to meet your ML inference requirements. It integrates with MLOps tools to allow you to scale your model deployment, reduce costs, manage models more efficiently in production, and reduce operational load. Amazon SageMaker can handle all your inference requirements, including low latency (a few seconds) and high throughput (hundreds upon thousands of requests per hour).

Robust Intelligence Platform seamlessly integrates into your ML lifecycle to eliminate any model failures. The platform detects weaknesses in your model, detects statistical data issues such as drift, and prevents data from being inserted into your AI system. A single test is the heart of our test-based approach. Each test measures the model's resistance to a particular type of production model failure. Stress Testing runs hundreds upon hundreds of these tests in order to assess model production readiness. These tests are used to automatically configure an AI Firewall to protect the model from the specific types of failures to which it is most vulnerable. Continuous Testing also runs these tests during production. Continuous Testing provides an automated root cause analysis that identifies the root cause of any test failure. ML Integrity can be ensured by using all three elements of Robust Intelligence.

Foundation models (FMs), the easiest way to create and scale generative AI apps, are available. Amazon Bedrock gives you the freedom to choose from a variety of FMs created by leading AI startups as well as Amazon. This allows you to find the best model for your needs. Bedrock's serverless environment allows you to get started quickly and customize FMs using your own data. You can then integrate and deploy these FMs into your applications with the AWS tools you are already familiar with. Choose FMs from AI21 Labs (Anthropic), Stability AI (Amazon), and Amazon to find FMs that are right for your application.

Overcome challenges when acquiring data to train AI and machine learning systems. Rendered.ai, a PaaS, is designed for data scientists and engineers. Create synthetic datasets to train and validate ML/AI. Experiment with scene content, sensor models, and post-processing. Catalogue and characterize real and synthetic datasets. Download or move data into your own cloud repositories to be processed and trained. Synthetic data can be used to boost innovation and productivity. Create custom pipelines for modeling diverse sensors and computer-vision inputs. Python sample code is available for free and can be customized to model SAR, RGB Satellite imagery, and other sensor types. Flexible licensing allows for almost unlimited content creation. Create labeled, high-performance computing content quickly in a hosted environment. No-code configuration allows data scientists and engineers to collaborate.

No more data catalog ghost cities. Acryl Cloud accelerates time-to-value for data producers through Shift Left practices and an intuitive user interface for data consumers. Continuously detect data-quality incidents in real time, automate anomaly detecting to prevent breakdowns, and drive quick resolution when they occur. Acryl Cloud supports both pull-based and push-based metadata ingestion to ensure information is reliable, current, and definitive. Data should be operational. Automated Metadata Tests can be used to uncover new insights and areas for improvement. They go beyond simple visibility. Reduce confusion and speed up resolution with clear asset ownership and automatic detection. Streamlined alerts and time-based traceability are also available.

It supports high-performance learning on AWS Trainium based Amazon Elastic Compute Cloud Trn1 instances. It supports low-latency and high-performance inference for model deployment on AWS Inferentia based Amazon EC2 Inf1 and AWS Inferentia2-based Amazon EC2 Inf2 instance. Neuron allows you to use popular frameworks such as TensorFlow or PyTorch and train and deploy machine-learning (ML) models using Amazon EC2 Trn1, inf1, and inf2 instances without requiring vendor-specific solutions. AWS Neuron SDK is natively integrated into PyTorch and TensorFlow, and supports Inferentia, Trainium, and other accelerators. This integration allows you to continue using your existing workflows within these popular frameworks, and get started by changing only a few lines. The Neuron SDK provides libraries for distributed model training such as Megatron LM and PyTorch Fully Sharded Data Parallel (FSDP).

Data is used to inform every aspect of a plant or facility. It is the basis for most operational processes, business decisions, and environmental events. This data is often blamed for failures, whether it's operator error, bad sensor, safety or environmental events or poor analytics. APERIO can help solve these problems. Data integrity is a critical element of Industry 4.0. It is the foundation on which more advanced applications such as predictive models and process optimization are built. APERIO DataWise provides reliable, trusted data. Automate the quality of PI data and digital twins at scale. Validated data is required across the enterprise in order to improve asset reliability. Empowering the operator to take better decisions. Detect threats to operational data in order to ensure operational resilience. Monitor & report sustainability metrics accurately.

Observability allows you to detect data issues and ML problems faster, to deliver continuous improvements and to avoid costly incidents. Start with reliable data. Monitor data in motion for quality issues. Pinpoint data and models drift. Identify the training-serving skew, and proactively retrain. Monitor key performance metrics continuously to detect model accuracy degradation. Identify and prevent data leakage in generative AI applications. Protect your generative AI apps from malicious actions. Improve AI applications by using user feedback, monitoring and cross-team collaboration. Integrate in just minutes with agents that analyze raw data, without moving or replicating it. This ensures privacy and security. Use the proprietary privacy-preserving technology to integrate the WhyLabs SaaS Platform with any use case. Security approved by healthcare and banks.

Use Qlik®, Staige™, to make AI real. It will provide a trusted foundation for data, automation, actionable forecasts, and a company-wide impact. AI is not just experiments and initiatives - it's a whole ecosystem of files, scripts and results. We've partnered up with the best sources to provide you with integrations that will save time, enable better management, and validate the quality of your data. Automate the delivery and management of real-time AWS data to data lakes or warehouses, and make this data easily accessible via a governed catalogue. With our new integration with Amazon Bedrock you can easily connect foundational large-language models (LLMs), including A21 Labs Amazon Titan, Anthropic Cohere and Meta. AWS customers can leverage AI-driven insights with ease using seamless integration with Amazon Bedrock.

Deep Learning Containers are Docker images pre-installed with the most popular deep learning frameworks. Deep Learning Containers allow you to quickly deploy custom ML environments without the need to build and optimize them from scratch. You can quickly deploy deep learning environments using prepackaged, fully tested Docker images. Integrate Amazon SageMaker, Amazon EKS and Amazon ECS to create custom ML workflows that can be used for validation, training, and deployment.

Use high-performance Linux to run all your cloud-based and enterprise applications. Amazon Linux 2 is an operating system for Linux from Amazon Web Services. It provides a stable, high-performance, security-focused execution environment for developing and running cloud applications. Amazon Linux 2 comes at no extra cost. AWS provides Amazon Linux 2 with ongoing security and maintenance updates. Amazon Linux 2 is optimized for performance and includes support for the latest Amazon EC2 capabilities. It includes packages to ease integration with AWS Services. Amazon Linux 2 provides long-term support. Developers, IT administrators and ISVs can enjoy the predictability and stability that comes with a Long-Term Support (LTS), but still have access to the most recent versions of popular software.