omnivore/packages/puppeteer-parse
2022-02-11 13:21:03 -08:00
..
test Open source omnivore 2022-02-11 09:24:33 -08:00
.env.example Open source omnivore 2022-02-11 09:24:33 -08:00
.gcloudignore Open source omnivore 2022-02-11 09:24:33 -08:00
.gitignore Open source omnivore 2022-02-11 09:24:33 -08:00
apple-news-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00
bloomberg-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00
index.js Open source omnivore 2022-02-11 09:24:33 -08:00
medium-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00
package.json Upgrade Cloud Storage and the apollo-express libraries 2022-02-11 13:21:03 -08:00
pdf-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00
README.md Open source omnivore 2022-02-11 09:24:33 -08:00
t-dot-co-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00
twitter-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00
youtube-handler.js Open source omnivore 2022-02-11 09:24:33 -08:00

Puppeteer parsing function handler

This workspace is used to provide the GCF for the app to hande requests for the article parsing via Puppeteer.

Using locally

Copy .env.example file to .env file: cp .env.example .env

Run yarn start to start the Google Cloud Function locally (Works without hot reloading).

After this, you should be able to access the functon on http://localhost:8080/puppeteer

Deployment

To deploy the function use the following command:

gcloud functions deploy puppeteer --runtime nodejs12 --trigger-http --memory 1GB --set-env-vars REST_BACKEND_ENDPOINT=<backend-address>,JWT_SECRET=<jwt-secret>

where:

<backend-address> - address of the backend server (e.g "http://localhost:4000")

<jwt-secret> - JWT secret that the backend server is using (e.g "some_secret")