Opened 7 weeks ago

Last modified 7 weeks ago

#2492 new enhancement

overturemaps python

Reported by: darkblueb Owned by: osgeolive@…
Priority: normal Milestone: OSGeoLive17.0
Component: OSGeoLive Keywords: python
Cc:

Description

## test install of overture maps client

user@osgeolive:~/Downloads$ pip3 install --upgrade-strategy=only-if-needed  --break-system-packages  overturemaps

Collecting overturemaps
  Downloading overturemaps-0.9.0-py3-none-any.whl.metadata (3.9 kB)
Collecting click>=8.1.7 (from overturemaps)
  Downloading click-8.1.7-py3-none-any.whl.metadata (3.0 kB)
Requirement already satisfied: numpy>=1.26.4 in /usr/lib/python3/dist-packages (from overturemaps) (1.26.4)
Collecting pyarrow>=15.0.2 (from overturemaps)
  Downloading pyarrow-18.0.0-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (3.3 kB)
Requirement already satisfied: shapely>=2.0.3 in /usr/lib/python3/dist-packages (from overturemaps) (2.0.3)
Downloading overturemaps-0.9.0-py3-none-any.whl (9.9 kB)
Downloading click-8.1.7-py3-none-any.whl (97 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.9/97.9 kB 269.5 kB/s eta 0:00:00
Downloading pyarrow-18.0.0-cp312-cp312-manylinux_2_28_x86_64.whl (40.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.0/40.0 MB 266.5 kB/s eta 0:00:00
Installing collected packages: pyarrow, click, overturemaps                                                                                  
...                          
                   
Successfully installed click-8.1.7 overturemaps-0.9.0 pyarrow-18.0.0  

## compare to fastparquet

user@osgeolive:~/Downloads$ pip3 install --upgrade-strategy=only-if-needed  --break-system-packages fastparquet

Collecting fastparquet
  Downloading fastparquet-2024.5.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Requirement already satisfied: pandas>=1.5.0 in /usr/lib/python3/dist-packages (from fastparquet) (2.1.4+dfsg)
Requirement already satisfied: numpy in /usr/lib/python3/dist-packages (from fastparquet) (1.26.4)
Collecting cramjam>=2.3 (from fastparquet)
  Downloading cramjam-2.9.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.9 kB)
Requirement already satisfied: fsspec in /usr/lib/python3/dist-packages (from fastparquet) (2024.2.0)
Requirement already satisfied: packaging in /usr/lib/python3/dist-packages (from fastparquet) (24.0)
Downloading fastparquet-2024.5.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.8 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.8/1.8 MB 267.1 kB/s eta 0:00:00
Downloading cramjam-2.9.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.4 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 266.8 kB/s eta 0:00:00
Installing collected packages: cramjam, fastparquet
Successfully installed cramjam-2.9.0 fastparquet-2024.5.0

user@osgeolive:~/Downloads/fastparquet-0.6.0$ ls
fastparquet/           LICENSE   MANIFEST.in  README.rst       requirements.txt  setup.py
fastparquet.egg-info/  Makefile  PKG-INFO     readthedocs.yml  setup.cfg

user@osgeolive:~/Downloads/fastparquet-0.6.0/fastparquet$ ls
api.py          converted_types.py  encoding.py*    parquet_thrift/       util.py
benchmarks/     core.py             __init__.py*    schema.py*            writer.py
compression.py  dataframe.py        parquet.thrift  thrift_structures.py

Change History (1)

comment:1 by darkblueb, 7 weeks ago

## sample dataset BELEM_BR

$ overturemaps download \
  --bbox=-48.52,-1.49,-48.4,-1.36 \
  -f geojson --type=building \
  -o belem.geojson

$ ogrinfo -so -al belem.geojson 
INFO: Open of `belem.geojson'
      using driver `GeoJSON' successful.

Layer name: belem
Geometry: Unknown (any)
Feature Count: 282332
Extent: (-48.507484, -1.490048) - (-48.399616, -1.357903)
Layer SRS WKT:
GEOGCRS["WGS 84",
 ...

## compare to osm_local

$ ogrinfo PG:dbname=osm_local planet_osm_polygon -so -al
INFO: Open of `PG:dbname=osm_local'
      using driver `PostgreSQL' successful.

Layer name: planet_osm_polygon
Geometry: Unknown (any)
Feature Count: 101098
Extent: (-48.510414, -1.519730) - (-48.370178, -1.351356)
Version 2, edited 7 weeks ago by darkblueb (previous) (next) (diff)
Note: See TracTickets for help on using tickets.