跳到主要內容
AI News HubLIVE
來源內容 · 翻譯待補全5 分鐘閱讀

待翻譯:Enhancing industrial safety AI with synthetic data on Amazon SageMaker AI

文章摘要

AI 服務暫時不可用,以下為來源摘要,待恢復後補全翻譯:Learn how to build a synthetic data augmentation pipeline on Amazon SageMaker AI and Amazon Rekognition that generates photo-realistic, auto-labeled training images for industrial safety AI. This approach improved person detection by up to 160% without manual annotation or hazardous data collection near heavy machinery.

來源AWS Machine Learning Blog作者: Dimitri Voytan
待翻譯:Enhancing industrial safety AI with synthetic data on Amazon SageMaker AI
報告錯誤

更正渠道尚未開通,可先複製下方文章資訊留存。

查看更正說明
直接讀正文

AI 服務暫時不可用,以下為來源正文,待恢復後補全翻譯。

Industrial safety AI refers to the use of technologies like computer vision and predictive analytics to find and stop workplace dangers. Synthetic data augmentation is emerging as a practical solution to one of the hardest problems in industrial safety AI: the scarcity of training images depicting people in dangerous proximity to heavy machinery. Industries deploying autonomous equipment (for example, agriculture, construction, mining, and manufacturing) need reliable person-detection models. However, the highest-risk scenarios (for example, a worker standing in a blind spot, a child near a moving implement) are precisely the ones that are rarest in real-world datasets. They are also the most dangerous to stage for data collection. In this post, we show how to use a synthetic data augmentation pipeline built on Amazon SageMaker AI and Amazon Rekognition to generate photo-realistic training images with automated labels. Our experiments showed up to 160 percent improvement in person detection mAP50 (mean Average Precision at an Intersection over Union threshold of 0.5) without manual annotation or hazardous photography sessions. The challenge: Training data scarcity for safety-critical edge cases Industrial companies developing AI-powered safety systems for heavy machinery face a critical bottleneck. They need thousands to millions of training images showing people in dangerous positions near equipment to train object detection models that can help prevent accidents. However, this data is extremely difficult to obtain: Safety and ethics: Deliberately placing people, including vulnerable populations such as children, near active machinery for photography is unsafe, unethical, and often impractical. Rarity of real events: The hazardous scenarios that matter most (a person standing on tracks, climbing on equipment, or in the path of a vehicle) are the rarest in naturally collected datasets. This creates severe class imbalance. Cost and scale: Manual data collection and annotation can cost an estimated $3–$5 per image and scales poorly, with annotation teams typically processing on the order of 2,000 images per day. Edge deployment constraints: Detection models must run on edge devices co-located with equipment (cameras mounted on tractors, forklifts, or railcars), constraining model size to lightweight architectures where every training example matters disproportionately. These challenges leave edge-deployed models with insufficient training signal for person detection in the exact scenarios where detection failures have the most severe consequences. Solution architecture This section describes our end-to-end synthetic data augmentation pipeline, which operates in two stages: photo-realistic image generation and automated labeling. Overview of the two-stage synthetic data generation framework Our solution is an end-to-end synthetic data augmentation pipeline that generates labeled training images without manual annotation. The pipeline operates in two stages: Photo-realistic synthetic image generation – A diffusion-based model (Qwen-Image-Edit-2509) hosted on Amazon SageMaker AI inserts synthetic people into real scene images while preserving background, lighting, and scale. Automated labeling – The Amazon Rekognition DetectLabels API automatically generates bounding-box annotations for the inserted people, alleviating manual annotation. In our approach, we edit real images rather than generating entirely synthetic scenes from scratch. This preserves background fidelity, avoids domain gap, and allows existing equipment annotations to remain valid. Domain gap is the performance drop that occurs when a model trained on one data distribution, such as fully synthetic scenes, is applied to real-world images. The diffusion model’s scene understanding produces contextually coherent insertions with realistic lighting and proportions. Stage 1: Photo-realistic synthetic image generation We deploy the Qwen-Image-Edit-2509 diffusion model on Amazon SageMaker AI using an ml.g5.12xlarge instance (4× NVIDIA A10G GPUs, 96 GB total VRAM). The model receives a structured prompt specifying: Object to insert: A person with randomized gender for demographic diversity. Placement strategy: Hazardous positioning relative to equipment (for example, on tracks, on top of equipment, hanging from edges, or standing in a vehicle’s path). Constraints: No distortion of existing elements, sharp focus, and realistic integration with the scene. The model edits real images containing equipment but no people as substrates, inserting synthetic people while preserving the original scene context, lighting, and scale. This in-place editing approach avoids the domain gap issues that plague fully synthetic scene generation. Stage 2: Automated labeling with Amazon Rekognition Each generated image is processed through the Amazon Rekognition DetectLabels API with a minimum confidence threshold of 80 percent. Detected bounding boxes are deduplicated by using non-maximum suppression (NMS) with IoU threshold > 0.5 and converted to YOLO format. These pseudo-labels (machine-generated annotations produced automatically in place of human labeling) are merged with existing equipment annotations from the original image. This automated labeling alleviates manual annotation for synthetic images while maintaining label quality sufficient for training edge-deployed detectors. The synthetic images and their automated annotations are combined with real training data to form the final training set. Pre- and post-processing steps (image filtering, image resizing, prompt assembly, and label processing) allow the pipeline to run as an automated workflow. Implementation details This section covers the model deployment configuration, the synthetic image generation methodology, and the automated annotation pipeline. Technical setup and configuration The Qwen-Image-Edit-2509 model is deployed on Amazon SageMaker AI with the following configuration: Instance type: ml.g5.12xlarge (4× NVIDIA A10G GPUs, 96 GB total VRAM). Model size: approximately 60 GB unquantized weights distributed across 4 GPUs. Inference steps: 25. CFG scale: 4.0. Minimum image dimension: 512 px. Generation time: ~166 seconds per image. The model requires a custom device map that distributes its 60 transformer layers across the available GPUS. For efficient inference, we recommend avoiding cross device communication. Deploy on a single gpu with sufficient VRAM, such as the NVIDIA H100 GPU provided by ml.p5.4xlarge instances, or employ weight quantization techniques. We project that inference cost per image will drop around 10x using such hardware, but this measurement is not yet validated. Synthetic human insertion methodology The pipeline selects real training images that contain locomotives but no people as editing substrates. For each image, the diffusion model receives a structured prompt. Here is an example prompt structure: PROMPT_TEMPLATE = """ Add one realistic person (gender: {gender}) to this image. Position the person in a hazardous place or position such as on the tracks, standing on top of the train, hanging on to the edge, etc. Verify the person is: - Accurately scaled and proportioned relative to other objects. Train cars are between 15-20 feet tall. A person should never be larger than a train car. - Naturally integrated into the scene's depth, perspective, and lighting. - Clearly visible and not blurred Lighting and atmosphere instructions: - Simulate lighting appropriate for {time_of_day} time, with consistent shadows and highlights. - Reflect the ambient condition of {ambient_condition} in the scene's atmosphere, visibility, and color tones. - Avoid artificial shine or polished textures. Machinery and surfaces should appear natural, with realistic textures (e.g., dust, dirt, faded paint). - Colors should be realistic and muted, not overly saturated. - Avoid glossy or polished finishes. Do not modify or distort any existing elements in the input image. The person must not appear larger or smaller than expected based on the scene's scale. Do not change any numbers, text, logos, or symbols on machinery or objects from the input image. Visual quality requirements: - Maintain sharp focus across the entire depth of the image, avoiding shallow depth-of-field effects. - Avoid: garbled face, floating or incomplete body parts, over-saturation, low resolution, grainy textures, pixelation, under/overexposure, poor color balance, washed-out tones, artifacts, color banding, outdated effects, unrealistic elements, poor compositing, visual noise, flickering, or background blur. - Verify: high realism, consistent geometry, natural integration of all elements, uniform sharpness across foreground and background, high-definition rendering with crisp details. """ Our experiments revealed a critical finding: prompt-guided placement is the single most important factor for downstream detection performance. Instructing the model to place people in domain-relevant hazardous positions doubled person detection mAP50, while placing people in the background actually degraded performance. Amazon Rekognition integration for automated annotation Each generated image is processed through the Amazon Rekognition DetectLabels API. The model computes bounding boxes for humans using the query words: person, human, man, woman, boy, girl, child, adult, people. This automates label creation at scale. We use: Minimum confidence threshold: 80 percent. Post-processing: Non-maximum suppression (NMS) with IoU threshold > 0.5. Label format: Bounding boxes converted to YOLO format and merged with existing equipment annotations. Dataset composition We used an OpenImages subset as a publicly shareable analog to our customer’s industrial equipment dataset: Real training images: approximately 3,200 images from OpenImages containing trains (as a proxy for heavy machinery). Synthetic augmentation: Up to 1,000 additional images with synthetically inserted people. Test set: Real OpenImages images only (no synthetic data), filtered to contain at least one locomotive. Task: 2-class detection (person and train) with severe class imbalance. Results and performance improvements We evaluated the impact of synthetic data augmentation across three dimensions: prompt placement strategy, synthetic data volume, and model capacity. Evaluation methodology We evaluated our pipeline using YOLO11 as a representative edge-deployable detector family, trained on Amazon SageMaker AI with PyTorch 2.1.0. Models were trained with image size 640, early stopping (patience 50), and a maximum of 500 epochs. Key finding 1: Domain-relevant placement doubles detection performance Our prompt ablation study with YOLO11-nano compared four synthetic data conditions against a real-data-only baseline. We used 1,000 synthetic images in each scenario. The following table shows key performance metrics for each scenario. Condition Person mAP50 Person Recall Person Precision Agg mAP50 (Person and Train) Baseline (real only) 0.051 0.170 0.338 0.517 Hazardous placement 0.106 0.234 0.409 0.558 Hazardous + scene variation 0.088 0.128 0.492 0.547 Background placement 0.046 0.219 0.217 0.527 Background + scene variation 0.051 0.085 0.421 0.532 Takeaway: What the model generates (a person in a domain-relevant position) matters far more than how the scene is varied around it (for example, ambient condition or time of day). Hazardous placement doubled person mAP50 (from 0.051 to 0.106), while background placement slightly degraded it. Key finding 2: Optimal synthetic volume is a hyperparameter To explore the impact of synthetic data volume on detection performance, we swept the number of synthetic images from 250-1,000 while keeping the person placement condition and model size constant (hazardous placement with no scene variation, YOLO11-nano). The [truncated for AI cost control]

展開要點與分析

文章情報

工程師進階

要點

  • AI 服務暫時不可用,系統已先保留來源內容與降級元數據。
  • Learn how to build a synthetic data augmentation pipeline on Amazon SageMaker AI and Amazon Rekognition that generates photo-realistic, auto-labeled training images for industrial…

技術影響

可能影響 GPU、推理集羣、算力成本和供應鏈規劃。

要點與分析由自動化流程生成,可能有誤,請結合原始來源核實。