title: Loading a large number of JSON files from GoogleCloudStorage to GoogleBigQuery
body: <p>I vacuumed log data from PostgreSQL by ruby scipt and stored into GoogleCloudStorage.
  Each file has a 10000 of user data and the total number of files are over 100000.Belows are part of files.
  <a href="https://i.stack.imgur.com/5GBne.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/5GBne.png" alt="part of the files"></a></p>
  
  <p>I downloaded each file into local machine and filtered gzip into JSON for BigQuery like<br> <code>jq -c ".[]" ~/Downloads/1-10000 &gt; ~/Downloads/1-10000.json</code><br>
  and<br> <code>bq load --source_format=NEWLINE_DELIMITED_JSON userdata.user_logs_1-10000 gs://user-logs/1-10000 schema.json</code><br> into BigQuery by hand.It succeed but this is not smart way and I can't repeat this.</p>
  
  <p>What is a best way to parse a huge amount of gzip file into json and load into BigQuery at once.</p>
  
  <p>I am open to all suggestions.Thank you.</p>