Introduction

Recent times have witnessed an increasing number of applications of deep neural networks towards solving tasks that require superior cognitive abilities, e.g., playing Go, generating art, ChatGPT, etc. Such a dramatic progress raises the question: how generalizable are neural networks in solving problems that demand broad skills? To answer this question, we propose SMART: a Simple Multimodal Algorithmic Reasoning Task (and the associated SMART-101 dataset) for evaluating the abstraction, deduction, and generalization abilities of neural networks in solving visuo-linguistic puzzles designed specifically for children of younger age (6--8). Our dataset consists of 101 unique puzzles; each puzzle comprises a picture and a question, and their solution needs a mix of several elementary skills, including pattern recognition, algebra, and spatial reasoning, among others. To train deep neural networks, we programmatically augment each puzzle to 2,000 new instances; each instance varied in appearance, associated natural language question, and its solution. To foster research and make progress in the quest for artificial general intelligence, we are publicly releasing our SMART-101 dataset, consisting of the full set of programmatically-generated instances of 101 puzzles and their solutions.

The dataset was introduced in our paper Are Deep Neural Networks SMARTer than Second Graders? by Anoop Cherian, Kuan-Chuan Peng, Suhas Lohit, Kevin A. Smith, and Joshua B. Tenenbaum, CVPR 2023

Files in the unzipped folder:

./README.md: This Markdown file

./SMART101-Data: Folder containing all the puzzle data. See below for details.

./puzzle_type_info.csv: Puzzle categorization (into 8 skill classes).

Dataset Organization

The dataset consists of 101 folders (numbered from 1-101); each folder corresponds to one distinct puzzle (root puzzle). There are 2000 puzzle instances programmatically created for each root puzzle, numbered from 1-2000. Every root puzzle index (in [1,101]) folder contains: (i) img/ and (ii) puzzle_.csv. The folder img/ is the location where the puzzle instance images are stored, and puzzle_.csv the non-image part of a puzzle. Specifically, a row of puzzle_.csv is the following tuple: `, whereidis the puzzle instance id (in [1,2000]),Questionis the puzzle question associated with the instance,imageis the name of the image (inimg/folder) corresponding to this instanceid,A, B, C, D, Eare the five answer candidates, andAnswer` is the answer to the question.

At a Glance

The size of the unzipped dataset is ~12GB.

The dataset consists of 101 folders (numbered from 1-101); each folder corresponds to one distinct puzzle (root puzzle).

There are 2000 puzzle instances programmatically created for each root puzzle, numbered from 1-2000.

Every root puzzle index (in [1,101]) folder contains: (i) img/ and (ii) puzzle_.csv.

The folder img/ is the location where the puzzle instance images are stored, and puzzle_.csv contains the non-image part of a puzzle. Specifically, a row of puzzle_.csv is the following tuple: `, whereidis the puzzle instance id (in [1,2000]),Questionis the puzzle question associated with the instance,imageis the name of the image (inimg/folder) corresponding to this instanceid,A, B, C, D, Eare the five answer candidates, andAnswer` is the correct answer to the question.

Other Details In our paper Are Deep Neural Networks SMARTer than Second Graders?, we provide four different dataset splits for evaluation: (i) Instance Split (IS), (ii) Answer Split (AS), (iii) Puzzle Split (PS), and (iv) Few-shot Split (FS). Below, we provide the details of each split to make fair comparisons to the results reported in our paper.

Puzzle Split (PS) We use the following root puzzle ids as the Train and Test sets.

    Split
    Root Puzzle Id Sets




    `Test`
    { 94,95, 96, 97, 98, 99, 101, 61,62, 65, 66,67, 69, 70, 71,72,73,74,75,76,77}


    `Train`
    {1,2,...,101} \ Test

Evaluation is done on all the Test puzzles and their accuracies averaged. For the 'Test' puzzles, we use the instance indices 1701-2000 in the evaluation.

Few-shot Split (FS)

We randomly select k number of instances from the Test sets (that are used in the PS split above) for training in FS split (e.g., k=100). These k few-shot samples are taken from instance indices 1-1600 of the respective puzzles and evaluation is conducted on all instance ids from 1701-2000.

Instance Split (IS)

We split the instances under every root puzzle as: Train = 1-1600, Val = 1601-1700, Test = 1701-2000. We train the neural network models using the Train split puzzle instances from all the root puzzles together and evaluate on the Test split of all puzzles.

Answer Split (AS)

We find the median answer value among all the 2000 instances for every root puzzle and only use this set of the respective instances (with the median answer value) as the Test set for evaluation (this set is excluded from the training of the neural networks).

Puzzle Categorization

Please see puzzle_type_info.csv for details on the categorization of the puzzles into eight classes, namely (i) counting, (ii) logic, (iii) measure, (iv) spatial, (v) arithmetic, (vi) algebra, (vii) pattern finding, and (viii) path tracing.

Other Resources

PyTorch code for using the dataset to train deep neural networks is available here.

Contact Anoop Cherian (cherian@merl.com), Kuan-Chuan Peng (kpeng@merl.com), or Suhas Lohit (slohit@merl.com)

Citation If you use the SMART-101 dataset in your research, please cite our paper:

@article{cherian2022deep, title={Are Deep Neural Networks SMARTer than Second Graders?}, author={Cherian, Anoop and Peng, Kuan-Chuan and Lohit, Suhas and Smith, Kevin and Tenenbaum, Joshua B}, journal={arXiv preprint arXiv:2212.09993}, year={2022} }

Copyright and Licenses

The SMART-101 dataset is released under CC-BY-SA-4.0.

Created by Mitsubishi Electric Research Laboratories (MERL), 2022-2023

SPDX-License-Identifier: CC-BY-SA-4.0

Comprehensive dataset of 101 Smart shops in ฺBangkok, Thailand as of July, 2025. Includes verified contact information (email, phone), geocoded addresses, customer ratings, reviews, business categories, and operational details. Perfect for market research, lead generation, competitive analysis, and business intelligence. Download a complimentary sample to evaluate data quality and completeness.

Water Meter Pics - 5,000+ photos

Dataset comprises 5,000+ photos of water meters, including high-quality images, segmentation masks, and OCR labels for meter readings. Each entry provides detailed information such as the meter reading value, bounding box coordinates, and segmentation data, making it ideal for training models in utility management, automatic meter reading (AMR), and water usage analysis.- Get the data

  Dataset characteristics:

Characteristic Data… See the full description on the dataset page: https://huggingface.co/datasets/ud-smart-city/water-meter-image.

This dataset represents ambient data collected longitudinally in 189 community homes. The data are collected over 18 years, from 2007 to 2024. This is a resource for analyzing naturalistic behavior in a home and building activity recognition models that operate in the wild.

Data are collected continuously from ambient sensors while residents perform their normal routines. The data fields are date, time, sensor identifier, and message. The sensors consist of PIR (motion) sensors and magnetic door (open/close) sensors. Sensors are attached to ceilings and identified by their location in the home (e.g., Bathroom, Bedroom, DiningRoom, Bed, Bath, OfficeChair). If a home contains more than one room of a given type, the corresponding sensors are distinguished by a trailing letter to differentiate the rooms (e.g., BedroomA, BedroomB). The lens of most motion sensors are constrained to cover a 1 meter diameter area. To detect movement in a larger area, an unconstrained sensor is angled to cover an entire room or region and is indicated by Area (e.g., BedroomArea).

There is one file per home. Some of the homes also include floorplans. Additionally, data from some of the homes is labeled with activities by an external annotator. There homes in this dataset are listed below with the number of residents.

101 Active Global Smart Card buyers list and Global Smart Card importers directory compiled from actual Global import shipments of Smart Card.

101 Active Global Smart meter suppliers, manufacturers list and Global Smart meter exporters directory compiled from actual Global export shipments of Smart meter.

Fatturato per gli ultimi anni, elenco utili/perdita, costo dipendenti, soci esponenti e contatti per SMART ENERGY 101 SOCIETA COOPERATIVA A RESPONSABILITA LIMITATA in VITTORIO VENETO (TV)

101 Global import shipment records of Smart Board And HSN Code 8528 with prices, volume & current Buyer's suppliers relationships based on actual Global export trade database.