The client is a technology company that leverages annotated videos and images for public property damage assessment. They share site inspection reports about the condition of damaged assets with municipalities and maintenance agencies for social and traffic safety.
Business Need.
The client worked with municipal agencies to prepare site inspection reports that would facilitate and help prioritize maintenance activities. They video recorded objects like pavements, traffic signals, lamp posts, road signs, road markings etc. to detect damage in them. The video recordings were then converted to image frames for annotating and marking broken/damaged objects. Annotated images were an integral part of the inspection reports on damage assessment submitted by the client to the authorities.
The municipal authorities required daily inspection reports to help them plan their maintenance logistics. Meeting this daily deadline was proving challenging for the client. So, they outsourced their video annotation operations to HitechDigital. The client also looked at this project as an opportunity to create a training dataset of annotated images to train their AI model for future use.
Challenges.
To be able to meet project objectives, we assessed and documented potential challenges before kickstarting the project.
The greatest challenge lay in the volumes – a daily count of 10 videos of 5 minutes each, to be converted to 100 frames, before annotating damaged objects.
The following activities were also assessed as time consuming:
Annotating damaged objects in each frame, both with bounding boxes and polygons, was time consuming.
Manually entering fields like names of route, video, frame etc. in an excel sheet for sending to client daily.
Annotating images in videos which were less bright.
Addressing frequently revised annotating instructions from client based on feedback they received from municipal authorities (this came us once the project started).
Identifying an opensource image annotation tool that met project compatibility requirements.
Solution.
Designed and implemented a three-step workflow which enabled daily delivery of 1,000 annotated video image frames of property and site damage assessment to municipal maintenance agencies. The steps primarily included annotation of damaged objects in image frames using bounding box and polygon techniques. Roboflow was the annotation tool used.
Project Samples.
Damaged Bench
Damaged Signboard
Signboard
Approach.
Data professionals, assigned to the project, were trained in identifying pavements, traffic signals, lamp posts, road signs, road markings etc.
We implemented the following steps on an ongoing basis as designed in the workflow:
Downloaded videos from Google Drive and entered all video details and attributes across multiple fields in a spreadsheet. These included video number, frame number and frame name among others.
All videos were converted into image frames (100 frames in a 5-min video).
We opened videos with low brightness in VLC player, adjusted the brightness and contrast, and then extracted the frames from the videos for annotating damaged objects.
We then identified damaged assets in each image frame.
The damaged objects in each of the frames were classified and annotated using Bounding box and Polygons.
Exported the annotated images and datasets into YOLO-8 format which was then uploaded onto client’s Google Drive. Daily reports with productivity metrics were sent to the client in a separate spreadsheet.
Quality check
To ensure 100% accuracy, all annotated images were verified for accuracy against pre-defined metrics by a dedicated QC person.
Tools and technology.
Roboflow tool for annotating images
Ask the Experts.
Schedule a free 30 minute consultation with our experts. We’d love to talk to you!
To provide the best experiences, we use technologies like cookies to store and/or access device information. Consenting to these technologies will allow us to process data such as browsing behavior or unique IDs on this site. Not consenting or withdrawing consent, may adversely affect certain features and functions.
Functional
Always active
The technical storage or access is strictly necessary for the legitimate purpose of enabling the use of a specific service explicitly requested by the subscriber or user, or for the sole purpose of carrying out the transmission of a communication over an electronic communications network.
Preferences
The technical storage or access is necessary for the legitimate purpose of storing preferences that are not requested by the subscriber or user.
Statistics
The technical storage or access that is used exclusively for statistical purposes.The technical storage or access that is used exclusively for anonymous statistical purposes. Without a subpoena, voluntary compliance on the part of your Internet Service Provider, or additional records from a third party, information stored or retrieved for this purpose alone cannot usually be used to identify you.
Marketing
The technical storage or access is required to create user profiles to send advertising, or to track the user on a website or across several websites for similar marketing purposes.