GBIF and Apache-Spark on Microsoft Azure tutorial - GBIF Data Blog

data-blog
1

GBIF now has a snapshot of 1.2 billion occurrences✝ records on Microsoft Azure.

This is a companion discussion topic for the original entry at https://data-blog.gbif.org/post/microsoft-azure-and-gbif/
3

I tried to set up a Databricks cluster in preparation for generating a species occurrence cube (Generate a species occurrence cube using Microsoft Azure Databricks :: Technical Documentation), but in vain.

I couldn’t get the databricks extension for Azure installed (on Windows). Apparently reading values from the registry fails - this is the error I get (admin rights have been granted):

File “C:\Program Files\Microsoft SDKs\Azure\CLI2\Lib\site-packages\pip_vendor\platformdirs\windows.py”, line 209, in get_win_folder_from_registry
directory, _ = winreg.QueryValueEx(key, shell_folder_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: [WinError 2] Das System kann die angegebene Datei nicht finden

Surprisingly, Google didn’t help at all. Did you experience something similar before, or are aware of someone who has the same issue?

Thanks and Cheers,
Jörg