Amazon Rekognition - Developer Guide

1 Amazon RekognitionDeveloper GuideAmazon Rekognition Developer GuideAmazon Rekognition : Developer GuideCopyright 2018 Amazon Web Services, Inc. and/or its affiliates. All rights 's trademarks and trade dress may not be used in connection with any product or service that is not Amazon 's, in any mannerthat is likely to cause confusion among customers, or in any manner that disparages or discredits Amazon . All other trademarks notowned by Amazon are the property of their respective owners, who may or may not be affiliated with, connected to, or sponsored Rekognition Developer GuideTable of ContentsWhat Is Amazon Rekognition ? .. 1 Amazon Rekognition and HIPAA Eligibility .. 2 Are You a First-Time Amazon Rekognition User? .. 3 How It Works .. 4 Types of Detection and Recognition.

2 4 Labels.. 4 Faces .. 5 Face Search .. 5 People .. 5 Celebrities.. 5 Text Detection .. 5 Unsafe Content.. 5 Image and Video Operations.. 6 Amazon Rekognition Image Operations .. 6 Amazon Rekognition Video Operations .. 6 Non-Storage and Storage Based Operations.. 6 Using the AWS SDK or HTTP to Call Amazon Rekognition API Operations .. 6 Non-Storage and Storage API Operations.. 7 Non-Storage Operations.. 7 Storage-Based API Operations.. 8 Model Versioning .. 9 Getting Started .. 11 Step 1: Set Up an Account .. 11 Sign up for AWS .. 11 Create an IAM User .. 12 Next Step .. 12 Step 2: Set Up the AWS CLI and AWS SDKs .. 12 Next Step .. 14 Step 3: Getting Started Using the AWS CLI and AWS SDK API .. 14 Formatting the AWS CLI Examples.

3 14 Next Step .. 14 Step 4: Getting Started Using the Console .. 14 Exercise 1: Detect Objects and Scenes (Console) .. 15 Exercise 2: Analyze Faces (Console) .. 20 Exercise 3: Compare Faces (Console) .. 22 Exercise 4: See Aggregated Metrics (Console) .. 24 Authentication and Access Control .. 25 Authentication.. 25 Access Control .. 26 Overview of Managing Access .. 26 Amazon Rekognition Resources and Operations .. 27 Understanding Resource Ownership .. 27 Managing Access to Resources .. 27 Specifying Policy Elements: Actions, Effects, and Principals .. 29 Specifying Conditions in a Policy .. 30 Using Identity-Based Policies (IAM Policies) .. 30 Permissions Required to Use the Amazon Rekognition Console .. 31 AWS Managed (Predefined) Policies for Amazon Rekognition .

4 31 Customer Managed Policy Examples .. 31 Amazon Rekognition API Permissions Reference .. 32 Working with Images .. 36 Images.. 36 Correcting Image Orientation .. 37 Best Practices for Working With Images .. 37iiiAmazon Rekognition Developer GuideAmazon Rekognition Image Operation Latency .. 37 Recommendations for Facial Recognition Input Images .. 37 Using an Amazon S3 Bucket .. 38 Using a Local File System.. 41 Using JavaScript .. 45 Getting Image Orientation and Bounding Box Coordinates .. 49 Finding an Image's Orientation .. 50 Displaying Bounding Boxes .. 50 Example: Getting Image Orientation and Bounding Box Coordinates For an Image .. 53 Working with Stored Videos .. 59 Types of Detection and Recognition .. 59 Amazon Rekognition Video API Overview.

5 59 Video Formats and Storage .. 60 Searching for People .. 60 Calling Amazon Rekognition Video Operations .. 61 Starting Video Analysis .. 61 Getting the Completion Status of an Amazon Rekognition Video Analysis Request .. 62 Getting Amazon Rekognition Video Analysis Results .. 63 Configuring Amazon Rekognition Video .. 66 Giving Access to Multiple Amazon SNS Topics .. 67 Giving Access to an Existing Amazon SNS Topic .. 68 Analyzing a Stored Video (SDK) .. 68 Prerequisites .. 69 Analyzing a Video (AWS CLI) .. 75 Prerequisites .. 69 Tutorial: Creating an Amazon Rekognition Lambda Function .. 77 Prerequisites .. 78 Create the SNS Topic .. 78 Create the Lambda Function .. 78 Configure the Lambda Function .. 78 Configure the IAM Lambda Role.

6 79 Create the AWS Toolkit for Eclipse Lambda Project .. 80 Test the Lambda Function .. 82 Reference: Video Analysis Results Notification .. 83 Troubleshooting Amazon Rekognition Video .. 84I never receive the completion status that's sent to the Amazon SNS topic .. 84 Working with Streaming Videos .. 86 Recognizing Faces in a Streaming Video .. 86 Prerequisites .. 87 Giving Access to Kinesis Streams .. 87 Giving Access to Your Kinesis Video Streams and Kinesis Data Streams .. 87 Giving Access to Individual Kinesis Streams .. 88 Starting Streaming Video Analysis .. 88 Creating the Amazon Rekognition Video Stream Processor .. 90 Starting the Amazon Rekognition Video Stream Processor .. 91 Using Stream Processors .. 91 Streaming Video into Amazon Rekognition Video.

7 95 Reading Analysis Results .. 95 Mapping the Kinesis Video Stream to the Kinesis Data Stream.. 97 Reference: Kinesis Face Recognition Record .. 97 JSON Record .. 99 InputInformation.. 99 KinesisVideo.. 99 StreamProcessorInformation .. 100 FaceSearchResponse .. 100 DetectedFace .. 100 MatchedFace .. 101ivAmazon Rekognition Developer GuideDetecting Objects and Scenes .. 102 Detecting Labels in an Image .. 102 DetectLabels Operation Request .. 103 DetectLabels Response .. 103 Detecting Labels in a Video .. 104 GetLabelDetection Operation Response .. 104 Detecting and Analyzing Faces .. 107 Detecting Faces in an Image .. 108 DetectFaces Operation Request .. 111 DetectFaces Operation Response .. 111 Comparing Faces in Images .. 117 CompareFaces Operation Request.

8 121 CompareFaces Operation Response .. 122 Detecting Faces in a Stored Video .. 124 GetFaceDetection Operation Response .. 127 Searching Faces in a Collection .. 130 Managing Collections .. 130 Managing Faces in a Collection .. 130 Searching for Faces Within a Collection .. 131 Using Similarity Thresholds to Match Faces .. 131 Using Amazon Rekognition to Help Public Safety .. 132 Creating a Collection .. 132 CreateCollection Operation Request .. 134 CreateCollection Operation Response .. 135 Listing Collections .. 135 ListCollections Operation Request .. 137 ListCollections Operation Response .. 138 Describing a Collection .. 138 DescribeCollection Operation Request .. 140 DescribeCollection Operation Response .. 140 Deleting a Collection.

9 141 DeleteCollection Operation Request .. 143 DeleteCollection Operation Response .. 143 Adding Faces to a Collection .. 143 IndexFaces Operation Request .. 147 IndexFaces Operation Response .. 147 Listing Faces in a Collection .. 152 ListFaces Operation Request .. 155 ListFaces Operation Response .. 155 Deleting Faces from a Collection .. 156 DeleteFaces Operation Request .. 158 DeleteFaces Operation Response .. 158 Searching for a Face (Face ID) .. 159 SearchFaces Operation Request .. 161 SearchFaces Operation Response .. 162 Searching for a Face (Image) .. 162 SearchFacesByImage Operation Request .. 166 SearchFacesByImage Operation Response .. 166 Searching Stored Videos for Faces .. 167 GetFaceSearch Operation Response.

10 170 Tracking People .. 174 GetPersonTracking Operation Response .. 176 Recognizing Celebrities .. 180 Recognizing Celebrities in an Image .. 180 Calling RecognizeCelebrities .. 180 RecognizeCelebrities Operation Request .. 184 RecognizeCelebrities Operation Response .. 184vAmazon Rekognition Developer GuideRecognizing Celebrities in a Stored Video .. 186 GetCelebrityRecognition Operation Response .. 189 Getting Celebrity Information .. 190 Calling GetCelebrityInfo .. 190 GetCelebrityInfo Operation Request .. 193.. 193 Detecting Unsafe Content .. 194 Detecting Unsafe Images (API) .. 194 Detecting Unsafe Content in an Image (SDK) .. 195.. 195 DetectModerationLabels Operation Request .. 198 DetectModerationLabels Operation Response .. 198 Detecting Unsafe Stored Videos.