We've been seeing some cross-version caching issues in the edx-platform-runner unit tests, which apparently run on a "dirty" environment—the virtualenv does not get cleared out between runs, which probably improves performance but allows installed dependencies to "leak" between runs. This results in errors between master and older open-releases but could also prevent us from noticing missing deps. By using pip-sync in the new CI Make targets (as we already do for the regular `make requirements` target) we can ensure that any stale dependencies from runs by other branches (or older versions of the code) are removed. Calling `make local-requirements` at the end of each `*-requirements` target rather than making it a prerequisite is necessary for using sync, since otherwise the local reqs would be wiped out. The `requirements` target is also deduplicated into the newer `dev-requirements` (aliased to it, with both installing private deps now.) Adding a prerequisite of `pre-requirements` allows us to simplify some workflow calls slightly. This ends up being the bulk of the commit by line count. The pip lockfile also wasn't being used in the Makefile, so I added that to pre-requirements as well. Also fix leading whitespace issue in Makefile.
86 lines
2.1 KiB
YAML
86 lines
2.1 KiB
YAML
name: Javascript tests
|
|
|
|
on:
|
|
pull_request:
|
|
branches:
|
|
- master
|
|
push:
|
|
branches:
|
|
- master
|
|
|
|
jobs:
|
|
run_tests:
|
|
name: JS
|
|
runs-on: ${{ matrix.os }}
|
|
strategy:
|
|
matrix:
|
|
os: [ ubuntu-20.04 ]
|
|
node-version: [ 16 ]
|
|
python-version: [ 3.8 ]
|
|
|
|
steps:
|
|
|
|
- uses: actions/checkout@v2
|
|
- name: Fetch master to compare coverage
|
|
run: git fetch --depth=1 origin master
|
|
|
|
- name: Setup Node
|
|
uses: actions/setup-node@v2
|
|
with:
|
|
node-version: ${{ matrix.node-version }}
|
|
|
|
- name: Setup npm
|
|
run: npm i -g npm@8.5.x
|
|
|
|
- name: Install Firefox 61.0
|
|
run: |
|
|
sudo apt-get purge firefox
|
|
wget "https://ftp.mozilla.org/pub/firefox/releases/61.0/linux-x86_64/en-US/firefox-61.0.tar.bz2"
|
|
tar -xjf firefox-61.0.tar.bz2
|
|
sudo mv firefox /opt/firefox
|
|
sudo ln -s /opt/firefox/firefox /usr/bin/firefox
|
|
|
|
- name: Install Required System Packages
|
|
run: sudo apt-get update && sudo apt-get install libxmlsec1-dev ubuntu-restricted-extras xvfb
|
|
|
|
- name: Setup Python
|
|
uses: actions/setup-python@v2
|
|
with:
|
|
python-version: ${{ matrix.python-version }}
|
|
|
|
- name: Get pip cache dir
|
|
id: pip-cache-dir
|
|
run: |
|
|
echo "::set-output name=dir::$(pip cache dir)"
|
|
|
|
- name: Cache pip dependencies
|
|
id: cache-dependencies
|
|
uses: actions/cache@v2
|
|
with:
|
|
path: ${{ steps.pip-cache-dir.outputs.dir }}
|
|
key: ${{ runner.os }}-pip-${{ hashFiles('requirements/edx/base.txt') }}
|
|
restore-keys: ${{ runner.os }}-pip-
|
|
|
|
- name: Install Required Python Dependencies
|
|
run: |
|
|
make base-requirements
|
|
|
|
- uses: c-hive/gha-npm-cache@v1
|
|
- name: Run JS Tests
|
|
env:
|
|
TEST_SUITE: js-unit
|
|
SCRIPT_TO_RUN: ./scripts/generic-ci-tests.sh
|
|
run: |
|
|
npm install -g jest
|
|
xvfb-run --auto-servernum ./scripts/all-tests.sh
|
|
|
|
- name: Save Job Artifacts
|
|
uses: actions/upload-artifact@v2
|
|
with:
|
|
name: Build-Artifacts
|
|
path: |
|
|
reports/**/*
|
|
test_root/log/*.png
|
|
test_root/log/*.log
|
|
**/TEST-*.xml
|