Commit Graph

60 Commits

Author SHA1 Message Date
Jesse Zoldak
1db4b052c0 No need to show pip freeze output on the console 2017-12-12 12:17:54 -05:00
Jeremy Bowman
05e7a4d671 PLAT-1830 Allow running any test suite in tox 2017-12-11 15:43:01 -05:00
Calen Pennington
653cc22580 Run pip freeze after installing python prereqs 2017-12-01 14:34:48 -05:00
John Eskew
8eb5945e39 Move Django requirement into separate file to enable tox testing. 2017-09-25 10:33:14 -04:00
John Eskew
d483fe1b68 Mirror the devstack prereqs in CircleCI and paver install_prereqs 2017-07-26 15:40:12 -04:00
Andy Armstrong
93235d118d Reorder imports using isort (except lms and cms) 2017-05-30 16:04:54 -04:00
Clinton Blackburn
8e1b9e1733 Added support for disabling removal of old Python libraries
The NO_PYTHON_UNINSTALL environment variable can now be used to disable the task that removes older versions of Python libraries. This task is not necessary for Docker images/containers since we always create a fresh virtualenv when we create the image.
2017-04-24 18:06:46 -04:00
Ned Batchelder
91a235a96d Fix two wrong egg names
These are the only two egg names that are wrong in this file.  We have
to uninstall i18n-tools, because the distribution name changed.  The
lti-consumer XBlock hasn't changed named, we just had the wrong name in
the requirements file.
2017-01-25 14:22:58 -05:00
Ben Patterson
67be6807a4 Add tests. Enjoy your coverage and feel confident. 2016-11-16 12:24:50 -05:00
Ben Patterson
f52e3cf830 Workaround for cb() never called errors
Problem:

Intermittent "cb() never called!" errors on npm installs for platform.
This is likely due to a race condition on installing OS-specific bits that are built during time of install. When more than one compilation takes place at one time, this error can occur.

Workaround:

Detect the error and re-run the install. (When retrying, one or all of the bits have been compiled. So running it again just finishes the install.)
2016-11-16 12:24:49 -05:00
Ben Patterson
b3a3d729a1 Use nodeenv to manage node version in Jenkins builds
This change:
* gives us the flexibility of managing node from pull-request to pull-request. It'll be a huge lift to folks that want to test out node upgrades like @bjacobel or @andy-armstrong
* Sets us up for a port to Xenial, which will be accomplished in part by using nodeenv for managing the node environment. See a companion PR on the configuration repo for edxapp: edx/configuration#3444

This pull request does not:
* Attempt to solve any stability issues in builds related to node.
* Make node installs any faster
* Create any caching infrastructure to speed up node installs. They will be approximately as fast as they were before. Downloading the node bits build-to-build adds about 3 seconds, which is worth it for the added flexibility.
2016-11-10 10:02:32 -05:00
stu
48b2575ca5 log pip freeze output for debugging jenkins builds 2016-11-01 11:21:46 -04:00
Jesse Zoldak
fea64a66ff Only install python coverage prereqs for coverage paver tasks TE-1673 2016-10-26 10:15:08 -04:00
Calen Pennington
ea28eb6197 Revert "Revert "Merge pull request #13021 from cpennington/paver-timing""
This reverts commit acf50c4469.
2016-08-03 16:13:10 -04:00
Calen Pennington
acf50c4469 Revert "Merge pull request #13021 from cpennington/paver-timing"
This reverts commit ed80381b41, reversing
changes made to 205cb8b3eb.
2016-07-26 13:32:59 -04:00
Calen Pennington
f94530ba12 [EV-62] Add the ability to log timing information during paver tasks 2016-07-22 10:54:48 -04:00
J. Cliff Dyer
f2ea041948 Allow paver users to uninstall obsolete python packages via a paver command.
MA-2250
2016-04-01 16:37:15 -04:00
J. Cliff Dyer
1df040228a Configure LMS to select oauth2 providing library.
Available backends:

* django-oauth-toolkit (DOT)
* django-oauth2-provider (DOP)

* Use provided client ID to select backend for
  * AccessToken requests
  * third party auth-token exchange
* Create adapters to isolate library-dependent functionality
* Handle django-oauth-toolkit tokens in edX DRF authenticator class

MA-1998
MA-2000
2016-03-30 14:21:27 +00:00
Jesse Zoldak
9251a6dc26 Always uninstall python packages on the uninstall list before installing the python requirements 2016-03-09 17:10:11 -05:00
Ned Batchelder
526db7293a A better way to manage the Python packages to uninstall. 2016-02-23 13:51:49 -05:00
Clinton Blackburn
8af930d2eb Fixed package uninstall for django-oauth2-provider
edx-django-oauth2-provider is being mistaken for django-oauth2-provider. Making the filter less liberal ensures we properly uninstall django-oauth2-provider once.

ECOM-3647
2016-02-11 11:46:38 -05:00
Clinton Blackburn
f78945bd1d Updated expected version for python_uninstall_version.txt
Follow up to #11432. This value needs to be incremented to ensure the old package is uninstalled.

ECOM-3647
2016-02-10 19:46:55 -05:00
Clinton Blackburn
219b7f75cf Merge pull request #11432 from edx/clintonb/oauth-client-credentials
Updated django-oauth2-provider
2016-02-10 16:44:37 -05:00
Clinton Blackburn
e92802b382 Updated django-oauth2-provider
New package includes support for client credentials grant.
2016-02-08 21:48:22 -05:00
Ben Patterson
f1b366589b Remove ruby dependencies.
Sass compilation is no longer dependent on Ruby, so we are
removing its dependencies.
2016-02-08 17:02:55 -05:00
Andy Armstrong
99c90a64dd Support compiling SASS for only one system 2016-01-29 12:43:15 -05:00
Jesse Zoldak
c5be59d8c7 Disable the pip version check message for uninstalls 2015-11-25 10:45:20 -05:00
Ned Batchelder
d3f9e1a7b2 Fix the uninstall of django-storages 2015-11-12 15:53:25 -05:00
Usman Khalid
fb9526b9cd Update expected_version. 2015-11-11 18:39:55 +05:00
muhammad-ammar
a6ec8cd2a4 add django-storages into uninstall list 2015-11-11 14:20:01 +05:00
Usman Khalid
6cb62f2697 Rebase upgrade Django to v1.8.5
Please note that this is a squshed commit and the work of:
Symbolist, macdiesel, nedbat, doctoryes, muzaffaryousaf and muhammad-ammar
2015-11-10 15:00:19 -05:00
Ben Patterson
a1bb822c8e Generify message. User will see context in previous console line. 2015-11-04 08:40:56 -05:00
Ned Batchelder
3f79dd0b75 If NO_PREREQ_INSTALL is set, print a message to explain why 2015-11-03 17:34:22 -05:00
Matt Drayer
1eab25f292 mattdrayer/increment-edx-lint: Bump to v0.2.9 and address pylint/pep8 violations
* Fix paver violations to stablize edx-lint update
* Parens, Line2Long
* Fix missing docstrings
* Fix PEP8 issues
* Address PR feedback (thanks @nedbat!)
2015-10-19 10:11:59 -04:00
Ned Batchelder
0dea5605c0 Disable the pip version check message
This message is being shown to people who should not be deciding whether
to upgrade pip, so it is just confusing and alarming noise.

Before:

---> pavelib.prereqs.install_prereqs
---> pavelib.prereqs.install_ruby_prereqs
Ruby prereqs unchanged, skipping...
---> pavelib.prereqs.install_node_prereqs
Node prereqs unchanged, skipping...
---> pavelib.prereqs.install_python_prereqs
pip install -q --exists-action w -r requirements/edx/pre.txt
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
pip install -q --exists-action w -r requirements/edx/github.txt
You are using pip version 6.0.8, however version 7.1.2 is available.
You should consider upgrading via the 'pip install --upgrade pip' command.
Could not find a tag or branch '96e1922348bfe6d99201b9512a9ed946c87b7e0b', assuming commit.
Could not find a tag or branch 'b0686a76f1ce3532088c4aee6e76b9abe61cc808', assuming commit.
Could not find a tag or branch '88ec8a011e481918fdc9d2682d4017c835acd8be', assuming commit.

After:

---> pavelib.prereqs.install_prereqs
---> pavelib.prereqs.install_ruby_prereqs
Ruby prereqs unchanged, skipping...
---> pavelib.prereqs.install_node_prereqs
Node prereqs unchanged, skipping...
---> pavelib.prereqs.install_python_prereqs
pip install -q --disable-pip-version-check --exists-action w -r requirements/edx/pre.txt
pip install -q --disable-pip-version-check --exists-action w -r requirements/edx/github.txt
Could not find a tag or branch '96e1922348bfe6d99201b9512a9ed946c87b7e0b', assuming commit.
Could not find a tag or branch 'b0686a76f1ce3532088c4aee6e76b9abe61cc808', assuming commit.
Could not find a tag or branch '88ec8a011e481918fdc9d2682d4017c835acd8be', assuming commit.
2015-09-08 07:18:15 -04:00
Jesse Zoldak
f8766891f0 No need to install prereqs twice on circleci.com 2015-08-06 13:09:06 -04:00
David Baumgold
2ff0f636ed Revert MySQL-python upgrade 2015-07-15 09:37:04 -04:00
Régis Behmo
95ebf7f675 Upgrade distribute to the latest stable version of setuptools
'distribute' is the ancestor of 'setuptools', and many packages require
setuptools to be installed.

Upgrade of MySQL-python from 1.2.4 to 1.2.5 is required because of an
incompatibility with setuptools>0.7.
2015-07-09 13:04:33 -04:00
Jonathan Piacenti
eabd6c8d27 Quality check and test fixes. 2015-01-12 13:41:03 +03:00
Jesse Zoldak
519d55585c Revert "Testeng/jenkins revisited" 2014-12-31 12:25:54 -05:00
Christine Lytwynec
2018acbce3 use pip-accel if it is available, get .pip/download-cache from S3
add script to upload/download pip cache directories from S3

update all-tests.sh to use pip-download-cache from S3

update pip-accel to version 0.22
2014-12-31 11:29:26 -05:00
Christine Lytwynec
e9e595749d fix NO_PREREQ_INSTALL 2014-11-21 14:24:14 -05:00
Ben Patterson
b2482f54f7 Check for npm registry and set it if necessary.
If paver is being run by a user that is not the same as the user
that installed npm on the guest machine, then paver install_prereqs fails
with the following error:

  ---> pavelib.prereqs.install_node_prereqs
  npm config set registry http://registry.npmjs.org/
  npm ERR! Error: EPERM, chown '/home/jenkins/.npmrc'
  npm ERR!  { [Error: EPERM, chown '/home/jenkins/.npmrc'] errno: 50, code: 'EPERM', path: '/home/jenkins/.npmrc' }
  npm ERR!
  npm ERR! Please try running this command again as root/Administrator.

  npm ERR! System Linux 3.2.0-23-generic
  npm ERR! command "/usr/bin/node" "/usr/bin/npm" "config" "set" "registry" "http://registry.npmjs.org/"
  npm ERR! cwd /home/jenkins/shallow-clone
  npm ERR! node -v v0.10.30
  npm ERR! npm -v 1.4.21
  npm ERR! path /home/jenkins/.npmrc
  npm ERR! code EPERM
  npm ERR! errno 50
  npm ERR! stack Error: EPERM, chown '/home/jenkins/.npmrc'
  npm ERR!
  npm ERR! Additional logging details can be found in:
  npm ERR!     /home/jenkins/shallow-clone/npm-debug.log
  npm ERR! not ok code 0

  Captured Task Output:
  ---------------------

  ---> pavelib.prereqs.install_prereqs
  ---> pavelib.prereqs.install_ruby_prereqs
  ---> pavelib.prereqs.install_node_prereqs
  npm config set registry http://registry.npmjs.org/

  Build failed running pavelib.prereqs.install_prereqs: Subprocess return code: 50

This change is a workaround. It will first see if the value is set. In the case
that is it not set, it will attempt to set it. (It will then fail; however,
re-running the task will subsequently be successful.)
2014-08-20 12:39:56 -04:00
Christine Lytwynec
245ed42ddb stop update_assets commands from being called extra times 2014-06-18 16:42:39 -04:00
e0d
2250338eba shim to update ruby/node, not python reqs 2014-06-13 17:42:28 -04:00
Christine Lytwynec
e0deca26fc fix for prereqs installation cache check 2014-06-02 10:47:32 -04:00
muhammad-ammar
8809c5f0e0 Merge pull request #3487 from edx/ammar/fix-paver-python-prereq-paths
Fix paver python prereq paths
2014-05-28 20:17:19 +05:00
Christine Lytwynec
550d054300 added and updated pavelib/quality.py from dglance branch, deprecated rake quality tasks 2014-05-23 13:19:27 -04:00
Jay Zoldak
4771242d57 Revert "added and updated pavelib/quality.py from dglance branch, deprecated rake quality tasks"
This reverts commit 7fd2305f39.
2014-05-23 08:40:43 -04:00
Christine Lytwynec
7fd2305f39 added and updated pavelib/quality.py from dglance branch, deprecated rake quality tasks 2014-05-20 16:22:28 -04:00