SWAPI Dataset

SWAPI (Star Wars API) is a web-based API providing structured and detailed information about the Star Wars universe, covering a variety of entities and their interrelations. The SWAPI dataset covers all the available data from the API.

It is structured in JSON format. The files are the following:

people with detailed information about characters
films with information about the Star Wars movies
planets with details about planets
species with characteristics of species
vehicles with specifications of vehicles
starhips with similar information as vehicles, but some added details

SWAPI dataset

Initial Dataset Specifications

Entity	Data Link	Mapping
People	Data Link	Mapping `_: { birth_year: 0, created: 1, edited: 2, eye_color: 3, gender: 7, hair_color: 8, height: 9, homeworld: 10, mass: 11, name: 12, skin_color: 13, url: 20, Array: -21 { _index: 22, vehicles.json: 23 }, Array: -17 { _index: 18, starships.json: 19 }, Array: -14 { _index: 15, species.json: 16 }, Array: -4 { _index: 5, films.json: 6 } }`
Films	Data Link	Mapping _: { created: 49, director: 50, edited: 51, episode_id: 52, opening_crawl: 53, producer: 57, release_date: 58, title: 65, url: 66, Array: -67 { _index: 68, vehicles.json: 69 { name: 70, model: 71 } }, Array: -62 { _index: 63, starships.json: 64 { name: 72, manufacturer: 73 } }, Array: -59 { _index: 60, species.json: 61 { name: 74, language: 75, homeworld: 76 } }, Array:-54 { _index: 55,_: { created: 49, director: 50, edited: 51, episode_id: 52, opening_crawl: 53, producer: 57, release_date: 58, title: 65, url: 66, Array: -67 { _index: 68, vehicles.json: 69 }, Array: -62 { _index: 63, starships.json: 64 }, Array: -59 { _index: 60, species.json: 61 }, Array:-54 { _index: 55, planets.json: 56 }, Array: -46 { _index: 47, people.json: 48 } } planets.json: 56 { climate: 77 } }, Array: -46 { _index: 47, people.json: 48 { name: 78, height: 79, gender: 80 } } }
Planets	Data Link	Mapping `_: { climate: 109, created: 110, diameter: 111, edited: 112, gravity: 116, name: 117, orbital_period: 118, population: 119, rotation_period: 123, surface_water: 124, terrain: 125, url: 126, Array: -120 { _index: 121, people.json: 122 }, Array: -113 { _index: 114, films.json: 115 } }`
Species	Data Link	Mapping `_: { average_height: 70, average_lifespan: 71, classification: 72, created: 73, designation: 74, edited: 75, eye_colors: 76, hair_colors: 80, homeworld: 81, language: 82, name: 83, skin_colors: 87, url: 88, Array: -84 { _index: 85, people.json: 86 }, Array: -77 { _index: 78, films.json: 79 } }`
Vehicles	Data Link	Mapping `_: { cargo_capacity: 89, consumables: 90, cost_in_credits: 91, created: 92, crew: 93, edited: 94, length: 98, manufacturer: 99, max_atmosphering_speed: 100, model: 101, name: 102, passengers: 103, url: 107, vehicle_class: 108, Array: -104 { _index: 105, people.json: 106 }, Array: -95 { _index: 96, films.json: 97 } }`
Starships	Data Link	Mapping `_: { MGLT: 24, cargo_capacity: 25, consumables: 26, cost_in_credits: 27, created: 28, crew: 29, edited: 30, hyperdrive_rating: 34, length: 35, manufacturer: 36, max_atmosphering_speed: 37, model: 38, name: 39, passengers: 40, starship_class: 44, url: 45, Array: -41 { _index: 42, people.json: 43 }, Array: -31 { _index: 32, films.json: 33 } }`

Generated Dataset Specifications

The film data is enriched by embedding detailed information from all referenced entities. Instead of storing only references (URLs) to related data, the selected details of these references are included as embedded objects within the film documents. The transformed dataset is then stored in MongoDB, with each film represented as a comprehensive, self-contained document.

By embedding all related details into each film document and storing it in MongoDB, the transformed SWAPI dataset becomes highly accessible, efficient, and scalable. It supports a wide range of applications, from backend APIs to analytical tools, and aligns well with MongoDB’s strengths in handling nested, hierarchical data.

Entity Output Mapping

Films

Entity	Output Mapping
Films	Output Mapping _: { created: 49, director: 50, edited: 51, episode_id: 52, opening_crawl: 53, producer: 57, release_date: 58, title: 65, url: 66, Array: -67 { _index: 68, vehicles.json: 69 { name: 70, model: 71 } }, Array: -62 { _index: 63, starships.json: 64 { name: 72, manufacturer: 73 } }, Array: -59 { _index: 60, species.json: 61 { name: 74, language: 75, homeworld: 76 } }, Array:-54 { _index: 55, planets.json: 56 { climate: 77 } }, Array: -46 { _index: 47, people.json: 48 { name: 78, height: 79, gender: 80 } } }

Output Mapping

_: {
  created: 49,
  director: 50,
  edited: 51,
  episode_id: 52,
  opening_crawl: 53,
  producer: 57,
  release_date: 58,
  title: 65,
  url: 66,
  Array: -67 {
      _index: 68,
      vehicles.json: 69 {
        name: 70,
        model: 71
      }
    },
  Array: -62 {
      _index: 63,
      starships.json: 64 {
        name: 72,
        manufacturer: 73
      }
    },
  Array: -59 {
      _index: 60,
      species.json: 61 {
        name: 74,
        language: 75,
        homeworld: 76
      }
    },
  Array:-54 {
      _index: 55,
      planets.json: 56 {
        climate: 77
      }
    },
  Array: -46 {
      _index: 47,
      people.json: 48 {
        name: 78,
        height: 79,
        gender: 80
      }
    }
}

Note: While it is technically possible to define a mapping that embeds the film data with details from referenced entities, it is currently not possible to generate the transformed data. This limitation arises because the Transformation modules in MM-cat are not yet equipped to handle array references effectively. Therefore, we do not provide the transformed dataset at this stage. Enhancements to the Transformation modules to address this limitation are planned for future development.

SWAPI Dataset

Initial Dataset Specifications

Generated Dataset Specifications

Case A: Embedding Film Data with Related Details from Referenced Files in MongoDB