Being able to quickly get your hands on datasets for testing algorithms and building models become a vital skills for contemporary data scientists and machine learning engineers. Being able to move a semi-complete dataset to one that is fully annotated, fleshed out with additional augmented data, and ready to move on to building models is equally important.
Here are 3 projects found around GitHub that can help with your data acquisition, annotation, and augmentation tasks.
1. Google Images Download
Need to build yourself a custom image dataset for your project? Google Images Download might be able to help.
Python Script to download hundreds of images from ‘Google Images’. It is a ready-to-run code!
Once you have acquired yourself some images, annotation might become a concern. This is where LabelImg comes in.
LabelImg is a graphical image annotation tool and label object bounding boxes in images.
Built with Python and Qt, LabelImg is a standalone application with a graphical user interface meant for annotating images.
Annotations are saved as XML files in PASCAL VOC format, the format used by ImageNet. Besides, it also supports YOLO and CreateML formats.
The GitHub repo has installation and usage info, and LabelImg seems to be an application you can get up and running — and using — quickly, allowing you to maximize time spent working on your dataset. Happy annotating!
Turning our attention from computer vision dataset tasks to natural language processing, let’s have a look at what TextAttack can do.
TextAttack is a Python framework for adversarial attacks, data augmentation, and model training in NLP.
TextAttack has a number of built-in recipes for augmenting text data, including: replacing words with WordNet synonyms; words with neighbors in the counter-fitted embedding space; substituting, deleting, inserting, and swapping adjacent characters; contraction/extension and by substituting names, locations, numbers; and more.
While herein we are highlighting the use case of using TextAttack to augment a dataset, here are the full breadth of its capabilities:
- Understand NLP models better…
Continue reading: https://www.kdnuggets.com/2021/08/3-data-labeling-synthesizing-augmentation-tools.html