UN Population WPP: https://esa.un.org/unpd/wpp/DVD/
Includes Following Indicators: BirthPer1000Population ChildDependencyRatio CrudeDeathRate DependencyRatio FeminityRatio FertilityRate InfantMortality LifeExpectancy MeanAgeForChildBearing MedianAgeOfPopulation Mortality NetMigrationRate NetNumberOfMigrants NetReporductionRate NoOfBirth OldAgeDependencyRatio PercentageTotalDeaths PercentageTotalPopulation Population PopulationDensity PopulationGrowthRate PotentialSupport RateOfNaturalIncrease SexRatio SurvivorAge TotalDeaths TotalFertility

how to generate the dataset

download all of the source files above and put them into etl/source dir.
run in commandline: cd etl/script && python unpop-main.py

notes:

Etl folder contains two extra excel files: Metadata.xlsx and CountryMetadata.xlsx. Metadata.xlsx is a masterfile for all the indicators and naming for folders. CountryMetadata.xlsx is masterfile for split of all the ref_area into World, Continent, Region and Country
Script supports multiple file loading and generate output into one file
Script also takes all Variants available in the excel file and generate variant dimention
NOTES sheet in each excel is not being included
Population indicator and 14 other indicator have multiple files. Because of that the information in concept.csv file for "Name" and "Description" column is generic and hard coded. Information can be found at updateConceptDF function
File iterats trough all 95 files and generate ddf dataset in 15 mins or so. Hard disk space requirements is 1.5GB for new files
Because of size of files, validate-ddf can not be run on whole dataset. it's been tested on individual folders though to check the data integrity.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

Population by age group from WPP

how to generate the dataset

notes:

About

Releases

Packages

Languages

Name		Name	Last commit message	Last commit date
Latest commit History 16 Commits
ddf--datapoints--birthper1000population--by--continent--year--variant--freq		ddf--datapoints--birthper1000population--by--continent--year--variant--freq
ddf--datapoints--birthper1000population--by--continent--year--variant		ddf--datapoints--birthper1000population--by--continent--year--variant
ddf--datapoints--birthper1000population--by--country--year--variant--freq		ddf--datapoints--birthper1000population--by--country--year--variant--freq
ddf--datapoints--birthper1000population--by--country--year--variant		ddf--datapoints--birthper1000population--by--country--year--variant
ddf--datapoints--birthper1000population--by--global--year--variant--freq		ddf--datapoints--birthper1000population--by--global--year--variant--freq
ddf--datapoints--birthper1000population--by--global--year--variant		ddf--datapoints--birthper1000population--by--global--year--variant
ddf--datapoints--birthper1000population--by--region--year--variant--freq		ddf--datapoints--birthper1000population--by--region--year--variant--freq
ddf--datapoints--birthper1000population--by--region--year--variant		ddf--datapoints--birthper1000population--by--region--year--variant
ddf--datapoints--childdependencyratio1564--by--continent--year--variant--gender		ddf--datapoints--childdependencyratio1564--by--continent--year--variant--gender
ddf--datapoints--childdependencyratio1564--by--continent--year--variant		ddf--datapoints--childdependencyratio1564--by--continent--year--variant
ddf--datapoints--childdependencyratio1564--by--country--year--variant--gender		ddf--datapoints--childdependencyratio1564--by--country--year--variant--gender
ddf--datapoints--childdependencyratio1564--by--country--year--variant		ddf--datapoints--childdependencyratio1564--by--country--year--variant
ddf--datapoints--childdependencyratio1564--by--global--year--variant--gender		ddf--datapoints--childdependencyratio1564--by--global--year--variant--gender
ddf--datapoints--childdependencyratio1564--by--global--year--variant		ddf--datapoints--childdependencyratio1564--by--global--year--variant
ddf--datapoints--childdependencyratio1564--by--region--year--variant--gender		ddf--datapoints--childdependencyratio1564--by--region--year--variant--gender
ddf--datapoints--childdependencyratio1564--by--region--year--variant		ddf--datapoints--childdependencyratio1564--by--region--year--variant
ddf--datapoints--childdependencyratio2064--by--continent--year--variant--gender		ddf--datapoints--childdependencyratio2064--by--continent--year--variant--gender
ddf--datapoints--childdependencyratio2064--by--continent--year--variant		ddf--datapoints--childdependencyratio2064--by--continent--year--variant
ddf--datapoints--childdependencyratio2064--by--country--year--variant--gender		ddf--datapoints--childdependencyratio2064--by--country--year--variant--gender
ddf--datapoints--childdependencyratio2064--by--country--year--variant		ddf--datapoints--childdependencyratio2064--by--country--year--variant
ddf--datapoints--childdependencyratio2064--by--global--year--variant--gender		ddf--datapoints--childdependencyratio2064--by--global--year--variant--gender
ddf--datapoints--childdependencyratio2064--by--global--year--variant		ddf--datapoints--childdependencyratio2064--by--global--year--variant
ddf--datapoints--childdependencyratio2064--by--region--year--variant--gender		ddf--datapoints--childdependencyratio2064--by--region--year--variant--gender
ddf--datapoints--childdependencyratio2064--by--region--year--variant		ddf--datapoints--childdependencyratio2064--by--region--year--variant
ddf--datapoints--childdependencyratio2069--by--continent--year--variant--gender		ddf--datapoints--childdependencyratio2069--by--continent--year--variant--gender
ddf--datapoints--childdependencyratio2069--by--continent--year--variant		ddf--datapoints--childdependencyratio2069--by--continent--year--variant
ddf--datapoints--childdependencyratio2069--by--country--year--variant--gender		ddf--datapoints--childdependencyratio2069--by--country--year--variant--gender
ddf--datapoints--childdependencyratio2069--by--country--year--variant		ddf--datapoints--childdependencyratio2069--by--country--year--variant
ddf--datapoints--childdependencyratio2069--by--global--year--variant--gender		ddf--datapoints--childdependencyratio2069--by--global--year--variant--gender
ddf--datapoints--childdependencyratio2069--by--global--year--variant		ddf--datapoints--childdependencyratio2069--by--global--year--variant
ddf--datapoints--childdependencyratio2069--by--region--year--variant--gender		ddf--datapoints--childdependencyratio2069--by--region--year--variant--gender
ddf--datapoints--childdependencyratio2069--by--region--year--variant		ddf--datapoints--childdependencyratio2069--by--region--year--variant
ddf--datapoints--childdependencyratio2564--by--continent--year--variant--gender		ddf--datapoints--childdependencyratio2564--by--continent--year--variant--gender
ddf--datapoints--childdependencyratio2564--by--continent--year--variant		ddf--datapoints--childdependencyratio2564--by--continent--year--variant
ddf--datapoints--childdependencyratio2564--by--country--year--variant--gender		ddf--datapoints--childdependencyratio2564--by--country--year--variant--gender
ddf--datapoints--childdependencyratio2564--by--country--year--variant		ddf--datapoints--childdependencyratio2564--by--country--year--variant
ddf--datapoints--childdependencyratio2564--by--global--year--variant--gender		ddf--datapoints--childdependencyratio2564--by--global--year--variant--gender
ddf--datapoints--childdependencyratio2564--by--global--year--variant		ddf--datapoints--childdependencyratio2564--by--global--year--variant
ddf--datapoints--childdependencyratio2564--by--region--year--variant--gender		ddf--datapoints--childdependencyratio2564--by--region--year--variant--gender
ddf--datapoints--childdependencyratio2564--by--region--year--variant		ddf--datapoints--childdependencyratio2564--by--region--year--variant
ddf--datapoints--childdependencyratio2569--by--continent--year--variant--gender		ddf--datapoints--childdependencyratio2569--by--continent--year--variant--gender
ddf--datapoints--childdependencyratio2569--by--continent--year--variant		ddf--datapoints--childdependencyratio2569--by--continent--year--variant
ddf--datapoints--childdependencyratio2569--by--country--year--variant--gender		ddf--datapoints--childdependencyratio2569--by--country--year--variant--gender
ddf--datapoints--childdependencyratio2569--by--country--year--variant		ddf--datapoints--childdependencyratio2569--by--country--year--variant
ddf--datapoints--childdependencyratio2569--by--global--year--variant--gender		ddf--datapoints--childdependencyratio2569--by--global--year--variant--gender
ddf--datapoints--childdependencyratio2569--by--global--year--variant		ddf--datapoints--childdependencyratio2569--by--global--year--variant
ddf--datapoints--childdependencyratio2569--by--region--year--variant--gender		ddf--datapoints--childdependencyratio2569--by--region--year--variant--gender
ddf--datapoints--childdependencyratio2569--by--region--year--variant		ddf--datapoints--childdependencyratio2569--by--region--year--variant
ddf--datapoints--crudedeathrateper1000population--by--continent--year--variant--freq		ddf--datapoints--crudedeathrateper1000population--by--continent--year--variant--freq
ddf--datapoints--crudedeathrateper1000population--by--continent--year--variant		ddf--datapoints--crudedeathrateper1000population--by--continent--year--variant
ddf--datapoints--crudedeathrateper1000population--by--country--year--variant--freq		ddf--datapoints--crudedeathrateper1000population--by--country--year--variant--freq
ddf--datapoints--crudedeathrateper1000population--by--country--year--variant		ddf--datapoints--crudedeathrateper1000population--by--country--year--variant
ddf--datapoints--crudedeathrateper1000population--by--global--year--variant--freq		ddf--datapoints--crudedeathrateper1000population--by--global--year--variant--freq
ddf--datapoints--crudedeathrateper1000population--by--global--year--variant		ddf--datapoints--crudedeathrateper1000population--by--global--year--variant
ddf--datapoints--crudedeathrateper1000population--by--region--year--variant--freq		ddf--datapoints--crudedeathrateper1000population--by--region--year--variant--freq
ddf--datapoints--crudedeathrateper1000population--by--region--year--variant		ddf--datapoints--crudedeathrateper1000population--by--region--year--variant
ddf--datapoints--dependencyratio1564--by--continent--year--variant--gender		ddf--datapoints--dependencyratio1564--by--continent--year--variant--gender
ddf--datapoints--dependencyratio1564--by--continent--year--variant		ddf--datapoints--dependencyratio1564--by--continent--year--variant
ddf--datapoints--dependencyratio1564--by--country--year--variant--gender		ddf--datapoints--dependencyratio1564--by--country--year--variant--gender
ddf--datapoints--dependencyratio1564--by--country--year--variant		ddf--datapoints--dependencyratio1564--by--country--year--variant
ddf--datapoints--dependencyratio1564--by--global--year--variant--gender		ddf--datapoints--dependencyratio1564--by--global--year--variant--gender
ddf--datapoints--dependencyratio1564--by--global--year--variant		ddf--datapoints--dependencyratio1564--by--global--year--variant
ddf--datapoints--dependencyratio1564--by--region--year--variant--gender		ddf--datapoints--dependencyratio1564--by--region--year--variant--gender
ddf--datapoints--dependencyratio1564--by--region--year--variant		ddf--datapoints--dependencyratio1564--by--region--year--variant
ddf--datapoints--dependencyratio2064--by--continent--year--variant--gender		ddf--datapoints--dependencyratio2064--by--continent--year--variant--gender
ddf--datapoints--dependencyratio2064--by--continent--year--variant		ddf--datapoints--dependencyratio2064--by--continent--year--variant
ddf--datapoints--dependencyratio2064--by--country--year--variant--gender		ddf--datapoints--dependencyratio2064--by--country--year--variant--gender
ddf--datapoints--dependencyratio2064--by--country--year--variant		ddf--datapoints--dependencyratio2064--by--country--year--variant
ddf--datapoints--dependencyratio2064--by--global--year--variant--gender		ddf--datapoints--dependencyratio2064--by--global--year--variant--gender
ddf--datapoints--dependencyratio2064--by--global--year--variant		ddf--datapoints--dependencyratio2064--by--global--year--variant
ddf--datapoints--dependencyratio2064--by--region--year--variant--gender		ddf--datapoints--dependencyratio2064--by--region--year--variant--gender
ddf--datapoints--dependencyratio2064--by--region--year--variant		ddf--datapoints--dependencyratio2064--by--region--year--variant
ddf--datapoints--dependencyratio2069--by--continent--year--variant--gender		ddf--datapoints--dependencyratio2069--by--continent--year--variant--gender
ddf--datapoints--dependencyratio2069--by--continent--year--variant		ddf--datapoints--dependencyratio2069--by--continent--year--variant
ddf--datapoints--dependencyratio2069--by--country--year--variant--gender		ddf--datapoints--dependencyratio2069--by--country--year--variant--gender
ddf--datapoints--dependencyratio2069--by--country--year--variant		ddf--datapoints--dependencyratio2069--by--country--year--variant
ddf--datapoints--dependencyratio2069--by--global--year--variant--gender		ddf--datapoints--dependencyratio2069--by--global--year--variant--gender
ddf--datapoints--dependencyratio2069--by--global--year--variant		ddf--datapoints--dependencyratio2069--by--global--year--variant
ddf--datapoints--dependencyratio2069--by--region--year--variant--gender		ddf--datapoints--dependencyratio2069--by--region--year--variant--gender
ddf--datapoints--dependencyratio2069--by--region--year--variant		ddf--datapoints--dependencyratio2069--by--region--year--variant
ddf--datapoints--dependencyratio2564--by--continent--year--variant--gender		ddf--datapoints--dependencyratio2564--by--continent--year--variant--gender
ddf--datapoints--dependencyratio2564--by--continent--year--variant		ddf--datapoints--dependencyratio2564--by--continent--year--variant
ddf--datapoints--dependencyratio2564--by--country--year--variant--gender		ddf--datapoints--dependencyratio2564--by--country--year--variant--gender
ddf--datapoints--dependencyratio2564--by--country--year--variant		ddf--datapoints--dependencyratio2564--by--country--year--variant
ddf--datapoints--dependencyratio2564--by--global--year--variant--gender		ddf--datapoints--dependencyratio2564--by--global--year--variant--gender
ddf--datapoints--dependencyratio2564--by--global--year--variant		ddf--datapoints--dependencyratio2564--by--global--year--variant
ddf--datapoints--dependencyratio2564--by--region--year--variant--gender		ddf--datapoints--dependencyratio2564--by--region--year--variant--gender
ddf--datapoints--dependencyratio2564--by--region--year--variant		ddf--datapoints--dependencyratio2564--by--region--year--variant
ddf--datapoints--dependencyratio2569--by--continent--year--variant--gender		ddf--datapoints--dependencyratio2569--by--continent--year--variant--gender
ddf--datapoints--dependencyratio2569--by--continent--year--variant		ddf--datapoints--dependencyratio2569--by--continent--year--variant
ddf--datapoints--dependencyratio2569--by--country--year--variant--gender		ddf--datapoints--dependencyratio2569--by--country--year--variant--gender
ddf--datapoints--dependencyratio2569--by--country--year--variant		ddf--datapoints--dependencyratio2569--by--country--year--variant
ddf--datapoints--dependencyratio2569--by--global--year--variant--gender		ddf--datapoints--dependencyratio2569--by--global--year--variant--gender
ddf--datapoints--dependencyratio2569--by--global--year--variant		ddf--datapoints--dependencyratio2569--by--global--year--variant
ddf--datapoints--dependencyratio2569--by--region--year--variant--gender		ddf--datapoints--dependencyratio2569--by--region--year--variant--gender
ddf--datapoints--dependencyratio2569--by--region--year--variant		ddf--datapoints--dependencyratio2569--by--region--year--variant
ddf--datapoints--feminityratio_femaleper100male--by--continent--year--variant--agebroad		ddf--datapoints--feminityratio_femaleper100male--by--continent--year--variant--agebroad
ddf--datapoints--feminityratio_femaleper100male--by--country--year--variant--agebroad		ddf--datapoints--feminityratio_femaleper100male--by--country--year--variant--agebroad
ddf--datapoints--feminityratio_femaleper100male--by--global--year--variant--agebroad		ddf--datapoints--feminityratio_femaleper100male--by--global--year--variant--agebroad
ddf--datapoints--feminityratio_femaleper100male--by--region--year--variant--agebroad		ddf--datapoints--feminityratio_femaleper100male--by--region--year--variant--agebroad

harpalshergill/ddf--unpop--wpp_population

Folders and files

Latest commit

History

Repository files navigation

Population by age group from WPP

how to generate the dataset

notes:

About

Resources

Stars

Watchers

Forks

Releases

Packages 0

Languages

Packages