uBlock/tools/make-assets.sh

#!/usr/bin/env bash
#
# This script assumes a linux environment

set -e

DES=$1/assets

echo "*** Packaging assets in $DES... "

rm -rf $DES
cp -R ./assets $DES/

mkdir $DES/thirdparties

git submodule update --depth 1 --init
UASSETS=submodules/uAssets

cp -R $UASSETS/thirdparties/easylist-downloads.adblockplus.org $DES/thirdparties/
cp -R $UASSETS/thirdparties/pgl.yoyo.org                       $DES/thirdparties/
cp -R $UASSETS/thirdparties/publicsuffix.org                   $DES/thirdparties/
cp -R $UASSETS/thirdparties/urlhaus-filter                     $DES/thirdparties/

mkdir $DES/ublock
cp -R $UASSETS/filters/* $DES/ublock/
# Optional filter lists: do not include in package
rm    $DES/ublock/annoyances.txt
Revert "Pass -e flag to bash (#3790)" This reverts commit bb2015949516346edb137384882022f839a187d2. 2021-07-31 18:49:32 +00:00			`#!/usr/bin/env bash`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 17:07:46 +00:00			`#`
			`# This script assumes a linux environment`

Use set -e in Bash scripts (#3791) 2021-07-31 21:34:25 +00:00			`set -e`

update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 17:07:46 +00:00			`DES=$1/assets`

Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-28 23:40:11 +00:00			`echo "*** Packaging assets in $DES... "`
this fixes travis? 2016-04-03 18:25:56 +00:00
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 17:07:46 +00:00			`rm -rf $DES`
Finalize converting resources.txt into immutable resources With hindsight, I revised decisions made earlier during this development cycle: Un-redirectable scriptlets have been removed from /web_accessible_resources and instead put in the new /assets/resources/scriptlets.js, which contains all scriptlets used for web page injection purpose. uBO will no longer fetch a remote version of built-in resources. Advanced setting `userResourcesLocation` will still be honoured by uBO, and if set, will be fetched every time at least one asset is updated. 2019-07-06 16:36:28 +00:00			`cp -R ./assets $DES/`
Leverage whotracks.me's huge dataset of URLs for benchmark purpose As seen at: https://whotracks.me/blog/adblockers_performance_study.html The requests.json.gz file can be downloaded from: https://cdn.cliqz.com/adblocking/requests_top500.json.gz Copy the file into ./tmp/requests.json.gz If the file is present when you build uBO using `make-[target].sh` from the shell, the resulting package will contain `./assets/requests.json`, which will be looked-up by the method below to launch a benchmark session. From uBO's dev console, launch the benchmark: µBlock.staticNetFilteringEngine.benchmark(); The usual browser dev tools can be used to obtain useful profiling data, i.e. start the profiler, call the benchmark method from the console, then stop the profiler when it completes. Keep in mind that the measurements at the blog post above where obtained with ONLY EasyList. The CPU reportedly used was: https://www.cpubenchmark.net/cpu.php?cpu=Intel+Core+i7-6600U+%40+2.60GHz&id=2608 Rename ./tmp/requests.json.gz to something else if you no longer want ./assets/requests.json in the build. 2019-02-15 21:18:03 +00:00
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 17:07:46 +00:00			`mkdir $DES/thirdparties`
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-28 23:40:11 +00:00
Make uAssets a submodule 2021-07-29 14:06:49 +00:00			`git submodule update --depth 1 --init`
			`UASSETS=submodules/uAssets`
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-28 23:40:11 +00:00
			`cp -R $UASSETS/thirdparties/easylist-downloads.adblockplus.org $DES/thirdparties/`
			`cp -R $UASSETS/thirdparties/pgl.yoyo.org $DES/thirdparties/`
			`cp -R $UASSETS/thirdparties/publicsuffix.org $DES/thirdparties/`
			`cp -R $UASSETS/thirdparties/urlhaus-filter $DES/thirdparties/`
update packaging scripts for https://github.com/uBlockOrigin/uAssets repo 2016-04-03 17:07:46 +00:00
			`mkdir $DES/ublock`
Remove requirement of uAssets presence to build a package Related discussion: - https://github.com/cliqz-oss/adblocker/pull/2075#discussion_r678654293 2021-07-28 23:40:11 +00:00			`cp -R $UASSETS/filters/* $DES/ublock/`
do not include optional annoyances.txt in extension package 2017-12-17 14:42:24 +00:00			`# Optional filter lists: do not include in package`
			`rm $DES/ublock/annoyances.txt`