Unable to install Pelias

[hznor]

Unable to install Pelias docker with instructions given in README.md for portland-metro.

Installation is failing at stage : "pelias download all", because two URLs are broken in the file: "pelias.json".

These two URLs are:

• https://s3.amazonaws.com/metro-extracts.nextzen.org/portland_oregon.osm.pbf
• http://www.c-tran.com/images/Google/GoogleTransitUpload.zip

To continue the installation I have replaced these URLs by these ones :

• https://github.com/rafapereirabr/otp-travel-time-matrix/blob/master/portland_oregon.osm.pbf?raw=true
• http://gtfs.s3.amazonaws.com/c-tran_20160404_0120.zip

Even though I have then be able to complete the stage : "pelias download all", I have been stuck at the stage : "pelias prepare all"

hznor@local:~/pelias/docker/projects/portland-metro$ pelias prepare all
/home/hznor/pelias/docker
/home/hznor/pelias/docker/lib/cli.sh
/home/hznor/pelias/docker/lib/env.sh
/home/hznor/pelias/docker/cmd/docker.sh
/home/hznor/pelias/docker/cmd/download.sh
/home/hznor/pelias/docker/cmd/elastic.sh
/home/hznor/pelias/docker/cmd/import.sh
/home/hznor/pelias/docker/cmd/prepare.sh
/home/hznor/pelias/docker/cmd/system.sh
/home/hznor/pelias/docker/cmd/test.sh
/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
Creating extract at /data/placeholder/wof.extract
no *.pbf files found in /data/openstreetmap directory
/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
import...
populate fts...
optimize...
close...
Done!
/usr/lib/python3/dist-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
  "class": algorithms.Blowfish,
error: no .pbf files found in /data/openstreetmap

[missinglink]

Duplicate of #293 (comment)

[hznor]

@missinglink The issue is different here:
After having updated the broken links in pelias.json, I still can't complete the installation since no .pbf files are found.

[missinglink]

Agh I've never seen these CryptographyDeprecationWarning: Blowfish warnings before 🤔

[hznor]

"error: no .pbf files found in /data/openstreetmap

Maybe the input files I have found to fix the broken links are incorrect?
Do you know which ones I should use instead to test it in the same conditions as you do?

[missinglink]

I'm not 100% clear on where this error is coming from since it's a python script and Pelias itself doesn't use python.

Maybe it's coming from docker-compose?

see: paramiko/paramiko#2038 (comment)

[missinglink]

It might also be that this message is only a warning and not the cause of the missing PBF files.

Are you able to download those files manually?

[hznor]

I could download them manually yes, but it seems that the installation scripts do not support http redirections.

I have been able to execute the stage: "pelias prepare all" after having changed the previous link by:
https://raw.githubusercontent.com/rafapereirabr/otp-travel-time-matrix/master/portland_oregon.osm.pbf

[missinglink]

FYI @hznor #309

note: the C-TAN data you found is from 2016.