Village data collection

[dhruv-1001]

Visit onlinemaps.surveyofindia.gov.in

Update your profile.

Select Click to buy

Select State & Dist you want to download data for. Keep adding till you have added all the districts for a state.

Place order on next screen. Download data one-by-one.

Data downloaded will be in .zip format, with file names as such

• Village Boundary Database.zip
• Village Boundary Database (1).zip
• Village Boundary Database (2).zip
• ... and so on

Extract these files
You will have .gdb folders for districts you have downloaded as such

• AGRA.gdb
• ALIGARH.gdb
• PRAYAGRAJ.gdb
• ... and so on

Now convert these files to .zip, to have files like this

• AGRA.zip
• ALIGARH.zip
• PRAYAGRAJ.zip
• ... and so on
  .zip to be created using this tool.

Now that you have .zip files for all districts of a state. You now need to upload these files to this repository using git lfs.

How to upload .zip files using git lfs

Make sure you have git lfs installed. Follow instructions provided here.

Once you have installed git lfs. Add everything you have downloaded, inside server/geojson-data/indian_village_boundaries.zip/ folder inside of a folder named after the state you have downloaded village data for.
Following the example above, it would look like such.

• indian_village_boundaries.zip
  • uttar_pradesh
    • AGRA.zip
    • ALIGARH.zip
    • PRAYAGRAJ.zip

Once you have files in this file structure, follows this documentation to add downloaded files using git lfs.

Once you are done, open up a PR to this repository

List to track data collection progress

• Village Data Collection - Andaman and Nicobar #37
• ANDHRA PRADESH
• Village Data Collection - ARUNACHAL PRADESH #76
• Village Data Collection - ASSAM #59
• BIHAR
• Village Data Collection - CHANDIGARH #100
• Village Data Collection - Chhattisgarh #71
• Village Data Collection - Delhi #62
• GOA
• GUJARAT
• Village Data Collection - HARYANA #104
• Village Data Collection - HIMACHAL PRADESH #77
• JAMMU AND KASMIR
• Village Data Collection - Jharkhand #61
• KARNATAKA
• KERALA
• Village Data Collection - LAKSHADWEEP #73
• Village Data Collection - MADHYA PRADESH #39
• MAHARASHTRA
• Village Data Collection - MANIPUR #111
• Village Data Collection - MEGHALAYA #75
• Village Data Collection - MIZORAM #47
• NAGALAND
• ODISHA
• Village Data Collection - PUDUCHERRY #50
• Village Data Collection - PUNJAB #40
• RAJASTHAN
• SIKKIM
• Village Data Collection - Tamil Nadu #36
• TELANGANA
• THE DADRA AND NAGAR HAVELI AND DAMAN AND DIU
• Village Data Collection - TRIPURA #46
• Village Data Collection - UTTAR PRADESH #38
• Village Data Collection - UTTARAKHAND #48
• Village Data Collection - WEST BENGAL #45

Note: Comment on this issue if you are interested. And i'll create and assign the state ticket for you.

[sagarkori143]

Hi @dhruv-1001 👋 I want to work on this. Please assign this to me. Thanks!

[jainvedant392]

Hey @dhruv-1001 , I would like to contribute to this issue. Could I start working on it?

[younome71]

Hey @dhruv-1001, I would like to contribute to this issue

[the-dg04]

Hey @dhruv-1001 , I would like to contribute to this issue. Can you please assign it to me?

[ChakshuGautam]

Hey please raise PRs state-wise we will merge them as they are ready. Thanks.

Please don't wait for it to be assigned.

[dhruv-1001]

Hey all, just mention for what states you will be uploading the data for. So that everyone have a different state.

[kumarguddu609]

Hey @dhruv-1001 I am doing BIHAR

[dhruv-1001]

Please select the one that we don't already have data for. Do refer the checklist.

[kumarguddu609]

okay

[Biswapremsahu77]

Hey @dhruv-1001 i want to work on this, and i can take tamil nadu.

[the-dg04]

Hey @dhruv-1001 i would like to do Andaman and Nicobar

[sagarkori143]

Ok @dhruv-1001 . I am taking the UP 🤩

[masterismail]

will do it for Telangana !

edit : data isn't available for any district of Telangana

[rd-sharma7]

@dhruv-1001 I checked a checklist & Will upload data for Madhya Pradesh.
inlast can I mention you ,if a doubt pop up there on comment or discord??

[sagarkori143]

Hey @dhruv-1001 . I am not able to locate this folder

Can you please help me in uploading the data

[dhruv-1001]

@sagarkori143, it doesn't exists. Just create dir along this path ./server/geojson-data/indiain_village_boundaries.zip/

[sagarkori143]

Okay Dhruv! Thanks!

[vilol-04]

hey @dhruv-1001 . I am interested to work on this issue. I'll be working for Chandigarh.

[kumarguddu609]

Hey @dhruv-1001
It gets error: can not upload new objects to public fork, when try to push git LFS objects to forked repository as github says

You can push Git LFS objects to public forks if the repository network already has Git LFS objects or you have write access to the root of the repository network.
git-lfs/git-lfs#1906

[younome71]

Hey @dhruv-1001, I will do for Punjab

[dhruv-1001]

will do it for Telangana !

edit : data isn't available for any district of Telangana

You can go ahead with some other state!

[dhruv-1001]

Hey @dhruv-1001 It gets error: can not upload new objects to public fork, when try to push git LFS objects to forked repository as github says

You can push Git LFS objects to public forks if the repository network already has Git LFS objects or you have write access to the root of the repository network.
git-lfs/git-lfs#1906

It seems to work for me. Here is an example PR. Can you list out what all steps are you following?

[rd-sharma7]

Thanks @sagarkori143 . your hint worked.

[jainvedant392]

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

[jainvedant392]

Hey @dhruv-1001 , I have created the PR for Haryana state. It would be delightful if you could make an issue for it and also attach the C4GT community label to it. Thank you.

[dhruv-1001]

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

Data for meghalaya & arunanchal pradesh is now available. Comment on tickets, and i'll assign those issues to you.
Edit: just checked, it says product is not available. Will have to wait until it's available.

[Biswapremsahu77]

Hey @dhruv-1001 i can do meghalaya and arunachal pradesh. You can assign it to me

[Ashurajput02]

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

Data for meghalaya & arunanchal pradesh is now available. Comment on tickets, and i'll assign those issues to you. Edit: just checked, it says product is not available. Will have to wait until it's available.

I can do for arunachal pradesh

[Biswapremsahu77]

Hey @dhruv-1001 , Can you please open an issue for Odisha as well? You can assign it to me.

[zeel991]

Hey @dhruv-1001 , Can you please open an issue for Odisha as well? You can assign it to me.

Odisha is already ticked in the Description if scenario was not so , I have prepared all the states data without an issue raised , except of those whose data isnt available

[Biswapremsahu77]

Ohh sorry , i didn't see that...😅😅😅, But why isn't its shown in the indian_village _boundaries folder?? @zeel991

[zeel991]

Ohh sorry , i didn't see that...😅😅😅, But why isn't its shown in the indian_village _boundaries folder?? @zeel991

No clue about that , but if the files are required , I am just a push command away to resolve the issue

[Biswapremsahu77]

Okkk..Great👍👍👍 @zeel991

[irfan-iiitr]

@zeel991 can i work on J&K.

[sagarkori143]

@zeel991 can i work on J&K.

Did you check whether data is available for J&K or not?

[irfan-iiitr]

@zeel991 yess some of the data of districts are available

[zeel991]

@zeel991 can i work on J&K.

Did you check whether data is available for J&K or not?

Data of some of the districts is available , data of other districts isn't there yet

[zeel991]

@zeel991 can i work on J&K.

You can go ahead , but i would say to wait until data of all the districts is available , as currently it would solve the issue partially

[irfan-iiitr]

@zeel991 would like to go ahead , when the rest of the data will be available pushing it will be just a click away

[zeel991]

@zeel991 would like to go ahead , when the rest of the data will be available pushing it will be just a click away

Sure! , I would go for Arunachal Pradesh and Meghalaya whenever data is available

[sagarkori143]

@zeel991 would like to go ahead , when the rest of the data will be available pushing it will be just a click away

Hey @irfan-iiitr Before going ahead with this let me know how many of the total are available there.

[irfan-iiitr]

@sagarkori143 6 out of 14 are available

[Harish-2003]

Hey @dhruv-1001 can i work on goa? and also i created an issue and pull request at #141 #142

[ramSeraph]

HI folks, Nice project you got going on here. Anyway I can help? I have the code to scrape the SOI website here - https://github.com/ramSeraph/opendata/blob/master/maps/SOI/scrape_villages.py. I hope you find it useful.

[ramSeraph]

Also, I would love to have a chat. Any place you folks hangout?

[yashpal2104]

Hey @dhruv-1001 can you assign one state to me I would love to contribute. I tried Meghalaya, Mizoram, Arunachal Pradesh but it seems it does not have data and says "Selected Product currently not available kindly contact Survey of India"