omnivore/packages/content-fetch
2022-12-28 15:28:27 +08:00
..
test Import puppeteer-parse in content-fetch 2022-11-16 10:15:49 +08:00
.dockerignore Add Dockerfile for pdfHandler 2022-10-04 15:28:12 +08:00
.env.example Update env example 2022-11-16 10:15:49 +08:00
.gcloudignore Remove content-fetch-gcf and create a Dockerfile for the cloud function 2022-11-16 10:15:49 +08:00
.gitignore Ignore app.yaml 2022-05-09 13:54:02 +08:00
app.js Fix puppeteer launch in head mode 2022-11-17 11:28:46 +08:00
Dockerfile Fix docker image 2022-12-28 15:28:27 +08:00
Dockerfile-gcf Fix docker image 2022-12-28 15:28:27 +08:00
index.js Import puppeteer-parse in content-fetch 2022-11-16 10:15:49 +08:00
logger.js Remove logging dependecies in puppeteer-parse 2022-11-17 11:28:26 +08:00
package.json Remove logging dependecies in puppeteer-parse 2022-11-17 11:28:26 +08:00
README.md Remove content-fetch-gcf and create a Dockerfile for the cloud function 2022-11-16 10:15:49 +08:00

Puppeteer parsing function handler

This workspace is used to provide the GCF for the app to hande requests for the article parsing via Puppeteer.

Using locally

Copy .env.example file to .env file: cp .env.example .env

Run yarn start to start the Google Cloud Function locally (Works without hot reloading).

After this, you should be able to access the functon on http://localhost:8080/puppeteer

Deployment

To deploy the function use the following command:

gcloud functions deploy puppeteer --runtime nodejs12 --trigger-http --memory 1GB --set-env-vars REST_BACKEND_ENDPOINT=<backend-address>,JWT_SECRET=<jwt-secret>

where:

<backend-address> - address of the backend server (e.g "http://localhost:4000")

<jwt-secret> - JWT secret that the backend server is using (e.g "some_secret")