MAPREDUCE Elite: Difference between revisions
From NoSQLZoo
No edit summary |
No edit summary |
||
Line 45: | Line 45: | ||
db.commodities.find_one() | db.commodities.find_one() | ||
) | ) | ||
</pre> | </pre> | ||
<div class="ans"> | <div class="ans"> | ||
Line 58: | Line 51: | ||
</div> | </div> | ||
<div class=q data-lang="py3">Each system has an allegiance. | <div class=q data-lang="py3">Each system has an <code>allegiance</code>. There are three main factions: <b>The Federation</b>, <b>The Empire</b>, and <b>The Alliance</b>.<br/> | ||
The Alliance consists of | <b>The Alliance</b> consists of independent systems, though an independent system is not necessarily part of <b>The Alliance</b>. In such a case their allegiance will be stored as "<b>Independent</b>"<br/> | ||
Finally, there are a few systems that are Anarchists, and come under | Finally, there are a few systems that are Anarchists, and come under <b>Anarchy</b>. Non-populated systems without stations do not have an allegiance, and should be ignored. | ||
<div class="hint" title="Dealing with None"> | <div class="hint" title="Dealing with None"> | ||
It's not possible to <code>emit</code> on a field that doesn't exist. Use <code>query</code> to remove documents where <b>allegiance</b> | It's not possible to <code>emit</code> on a field that doesn't exist. Use <code>query</code> to remove documents where <b>allegiance</b> doesn't exist. | ||
</div> | </div> | ||
<p class="strong>Show the amount of systems | <p class="strong>Show the amount of systems following each type of allegiance.</p> | ||
<pre class=def> | <pre class=def> | ||
</pre> | </pre> | ||
<div class="ans"> | <div class="ans"> | ||
temp = db.systems.map_reduce( query={"allegiance": {"$ne":None}}, map=Code("function(){emit(this.allegiance, | temp = db.systems.map_reduce( query={"allegiance": {"$ne":None}}, map=Code("function(){emit(this.allegiance, 1)}"), reduce=Code("""function(key,values){var total = 0;values.forEach(function(value){total += value;});return total;} """), out={"inline":1} );pp.pprint(temp['results']) | ||
</div> | </div> | ||
</div> | </div> |
Revision as of 11:14, 24 July 2015
#ENCODING import io import sys sys.stdout = io.TextIOWrapper(sys.stdout.buffer, encoding='utf-16') #MONGO from pymongo import MongoClient client = MongoClient() client.elite.authenticate('scott','tiger') db = client['elite'] #PRETTY import pprint pp = pprint.PrettyPrinter(indent=4) #JS from bson.code import Code
Introducing the elite database **WORK IN PROGRESS
These questions will introduce the "elite" database, which contains data about the video game Elite Dangerous
There are two collections, commodities
and systems
. Inside systems
there is are nested documents called stations
A system has many stations, and a station has many trade listings
Keys used in this database.
commodities: _id, average_price, category, name systems: _id, allegiance, faction, government, name, population, primary_economy, security, state, stations, updated_at, x, y, z systems.stations: allegiance, distance_to_star, economies, export_commodities,has_blackmarket, has_commodities, has_rearm, has_repair, has_shipyard, has_outfitting, faction, government, listings, max_landing_pad, name, state, type, updated_at systems.stations.listings: buy_price, collected_at, demand, commodity, sell_price, supply, update_count
Read more about the structure here: Elite Document Structure
Questions
commodities
collection contains the name
and average_price
of each commodity.There are 99 unique commodities and 15 categories.
Find the average price of each category, round to the nearest whole number
from bson.code import Code pp.pprint( db.commodities.find_one() )
from bson.code import Code;temp = db.commodities.map_reduce( map=Code("function(){emit(this.category,this.average_price)}"), reduce=Code("""function(key,values){var total = 0;for (var i = 0; i < values.length; i++){total += values[i];}return Math.round(total/values.length);} """),out={"inline":1} );pp.pprint(temp['results'])
allegiance
. There are three main factions: The Federation, The Empire, and The Alliance.The Alliance consists of independent systems, though an independent system is not necessarily part of The Alliance. In such a case their allegiance will be stored as "Independent"
Finally, there are a few systems that are Anarchists, and come under Anarchy. Non-populated systems without stations do not have an allegiance, and should be ignored.
It's not possible to emit
on a field that doesn't exist. Use query
to remove documents where allegiance doesn't exist.
Show the amount of systems following each type of allegiance.
temp = db.systems.map_reduce( query={"allegiance": {"$ne":None}}, map=Code("function(){emit(this.allegiance, 1)}"), reduce=Code("""function(key,values){var total = 0;values.forEach(function(value){total += value;});return total;} """), out={"inline":1} );pp.pprint(temp['results'])