Wykres commitów

59 Commity (main)

Autor SHA1 Wiadomość Data
Simon Li ebdd121b05 Update zenodo mocks 2023-10-15 17:17:59 +01:00
Simon Li 74a94cf2b0 Test resolving DOI
This helps distinguish temporary(?) errors in the DOI resolution from errors in the content provider
2023-10-15 17:17:55 +01:00
Philip Durbin 48f4cc630e make isort happy with pre-commit run --all-files #1242 2023-03-29 05:35:08 -04:00
Philip Durbin 938d91c9ca download original file formats from Dataverse #1242
Dataverse creates plain-text, preservation-friendly copies of certain
file formats (some of which are proprietary, such as Stata or SPSS) and
this .tab (tab-separated) file is downloaded unless you supply
`format=original`, which is what this pull request does.

The original filename (e.g. foo.dta, a Stata file) comes from
`originalFileName`, which is only populated when the preservation copy
(e.g. foo.tab) has been successfully created.

Additional variables were created to distinguish between `filename`,
`original_filename`, and `filename_with_path`. If `original_filename`
is available, it's the right one to use.

To allow the tests to continue passing, the query parameters are now
removed so just the file id can be cast as an int.
2023-03-10 16:46:05 -05:00
pre-commit-ci[bot] 3e6951c02e [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2023-02-03 14:22:06 +00:00
pre-commit-ci[bot] 27c2b403db [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2022-10-31 22:32:14 +00:00
pre-commit-ci[bot] 5a93542321 [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
2022-10-31 21:22:32 +01:00
Min RK e9ad8fdb41
run submodule test over https
avoids assertion with file-based submodules
2022-10-24 14:30:08 +02:00
YuviPanda b97db1066d Fix indexes in tests that look for staging zenodo 2022-07-28 10:02:10 -07:00
Min RK 8ab5c81245 remove deprecated call to distutils strtobool 2022-01-26 09:56:15 +01:00
Anton Akhmerov 8db656d1ce
always unpack a single zenodo zip 2021-07-06 15:18:42 +02:00
Mridul Seth 3edc76342c Fix regression in hydroshare introduced after moving to requests 2021-04-01 15:31:19 +02:00
Mridul Seth 0885204a5d fix dataverse regression introduced in last release 2021-02-11 21:58:21 +01:00
Tim Head 1140dd1919
Merge pull request #988 from douardda/swhid 2021-01-26 13:56:29 +01:00
Tim Head 45229ad613
Merge pull request #1001 from manics/fix_figshare_test 2021-01-20 11:20:13 +01:00
David Douard e54c24ce2e Add support for the SWHID content provider
This content provider allows to retrieve the content from a
Software Heritage (SWH) persistent identifier (SWHID).
Typical usage:

  repo2docker swh:1:rev:94dca98c006b80309704c717b5d83dff3c1fa3a0

It uses the SWH public vault API to retrieve the content of the given
directory.

Most of the times, this will not need an authentication
token to bypass the rate-limiting of the SWH API.
Without authentication, one should be allowed to retrieve one
directory content per minute.

If this is not enought, then the user must use authenticated calls to
the SWH API.

For this, a new `swh_token` config item has been added to the Repo2Docker
application class.

To use authentication:

  repo2docker --config cfg.json swh:1:rev:94dca98c006b80309704c717b5d83dff3c1fa3a0

with the swh_token config option being defined in the cfg.json config file.
2021-01-19 18:04:46 +01:00
David Douard 830a9c89c0 Replace urllib by requests in contentproviders
requests is globally simpler to use, and more and more people
are more familiar with this later than urllib.
2021-01-18 17:29:53 +01:00
Simon Li 5e6aa2aa9b Mark failing figshare tests as xfail 2021-01-09 11:36:12 +00:00
Simon Li bcc97a2382 Bug in figshare?
It looks like the new figshare redirects may drop the version suffix causing two tests to fail (see the test comments).
2021-01-08 23:48:58 +00:00
paugier 05002a4177 hg-evolve required for Mercurial support (simpler) 2020-09-14 14:05:52 +02:00
paugier 39081b70c3 Fix bug hg id topic 2020-09-11 00:36:28 +02:00
paugier 64633bbcbc Documentation about Mercurial support 2020-09-11 00:10:55 +02:00
paugier 3cdde89328 By default run Mercurial tests + enable the topic extension from code (no need for config file) 2020-09-10 21:48:46 +02:00
paugier 5bb586931b Mercurial optional 2020-09-10 07:58:21 +02:00
paugier c91ed4eec5 Mercurial: remove conditions for py3.5 + requirements only in setup.py 2020-09-08 10:09:13 +02:00
paugier fc3cef16a1 Fix test_mercurial.py (black, node_id and git->hg) 2020-09-07 09:51:30 +02:00
paugier 2d2e9bf19a Skip Mercurial for Python 3.5 2020-09-07 09:38:07 +02:00
paugier e520b900bf Add a Mercurial contentprovider
MyBinder could support Mercurial repositories

See https://github.com/jupyterhub/binderhub/issues/1148
2020-09-04 15:14:04 +02:00
Scott Black 02d0107510 Merge remote-tracking branch 'upstream/master' into hydroshare-content-provider 2020-01-29 10:14:01 -07:00
Scott Black 0c15cb1251 cleanup tests and formatting 2019-12-07 13:34:49 -07:00
Scott Black cb7bb0bb43 remove test parameterization and use fix regex match 2019-12-06 17:36:50 -07:00
Scott Black 776d538689 update tests and code to follow best practices pointed out in review 2019-12-06 16:31:59 -07:00
David Brochart 56e6c116f3 Add test 2019-11-05 18:01:06 +01:00
Scott Black d657453b3f update hydroshare version fetch to assume timestamp is in utc 2019-10-01 11:16:34 -06:00
Scott Black dddc45acfb reformatting with lint 2019-09-30 13:50:24 -06:00
Scott Black 21e61f3099 add hydroshare resource versioning and raise exception fetch fails 2019-09-25 14:37:19 -06:00
Scott Black d89f3a66aa update hydroshare content provider to doi and add tests 2019-09-25 09:59:44 -06:00
Kacper Kowalik (Xarthisius) 4df4fd6ab4
Download individual files instead of zip bundle 2019-09-17 15:44:56 -05:00
Kacper Kowalik (Xarthisius) a2f8228b15
Match DV hosts based on netloc instead of url 2019-09-16 15:03:12 -05:00
Kacper Kowalik (Xarthisius) 8edafd0d07
Add tests 2019-09-13 13:42:41 -05:00
Daniel Nüst a40e1799bd fix content_id for Figshare 2019-09-11 13:45:16 +02:00
Daniel Nüst f1ec646d2e add support for Figshare versions > 9 2019-09-11 13:18:20 +02:00
Daniel Nüst 698b8a1d7e try to improve test coverage 2019-09-11 13:17:48 +02:00
Daniel Nüst b2b75600c0 handle versions in Figshare properly 2019-09-09 08:37:02 +02:00
Daniel Nüst b2b6030492 initialize hosts as instance variable 2019-09-08 21:39:48 +02:00
Daniel Nüst e6cd4b19d9 reuse hosts definition in Zenodo tests 2019-09-08 14:51:17 +02:00
Daniel Nüst 0e4029bb8d add Figshare content provider
moving common functions to a DoiProvider
2019-09-08 14:51:17 +02:00
Tom Morrell 93147888c5 Reformatting and better tests 2019-06-20 13:22:17 -07:00
Tom Morrell 6d785404fb Typo 2019-06-19 08:38:24 -07:00
Tom Morrell 55b19b8369 Typo 2019-06-18 15:30:37 -07:00