feature, bulk importing of repositories

[bradder555]

Recently i hacked about in the back-end and database to migrate all of our stash repositories and jam these into gitea.

It's not an operation that i'll need to repeat, as far as i can tell in the documentation there's no procedure for doing this sort of thing.

I was thinking, as a feature, it might be handy to have an "upload zip" for migration to facilitate easy migration from other git servers.

I'm sure there're higher priorities, but figured it would make it easier for people to migrate and adopt gitea.

Thanks

[lunny]

You can do migrations via API. Write some scripts to do that.

[lafriks]

Such migrations should be done in scripts or external tools but should not be part of main gitea repo

[tacotexmex]

Any pointers to valid Github-to-Gitea scripts? I come up empty.

[techknowlogick]

@tacotexmex currently @JonasFranzDEV has a really good one: https://git.jonasfranz.software/JonasFranzDEV/gitea-github-migrator

[tacotexmex]

Thank you very much @tecknowlogick. * quietly thinking how I could’ve discovered this selfhosted gem without your help, dreaming of a federation of Gitea instances, Mastodon-style *

[techknowlogick]

@tacotexmex you are very welcome. Currently there is a working group that is dedicated to solving the issue of federated services. I actually just spent the morning catching up on discussions from the group. If you want to follow along you can see: forgefed/forgefed#5 Unrelated to federation we have a discord channel where the above tool was posted to.

[davidak]

Such migrations should be done in scripts or external tools but should not be part of main gitea repo

@lafriks why? i think migration should be as simple as possible.

imagine a workflow like this:

1. login to gitea with github
2. click "import from github"
3. select repos you want to import (all selected by default)
4. wait some seconds (or minutes) ... migration done

if load on the gitea server could be a problem, a queue could be implemented.

[lafriks]

@davidak while I agree that it should be as simple as possible but if we implement imports from github/bitbucket/gitlab etc it will be hard keep up with their api changes. There is example that it can be easily done outside of Gitea main code base - https://git.jonasfranz.software/JonasFranzDEV/gitea-github-migrator

Of course there are few things that we need to implement in Gitea API to have possibility to import more data but that's other thing

[xeddmc]

Anyone have a mirror or copy of https://git.jonasfranz.software/JonasFranzDEV/gitea-github-migrator ? The site is throwing a 500 error when trying to either clone the repo locally or even download the source code.

[lafriks]

@JonasFranzDev your server has problems ;)

[techknowlogick]

Edit, use at your own risk and don't randomly download zips from the internet.

[xeddmc]

Cheers guys, thanks 😄

[nodiscc]

https://git.jonasfranz.software/JonasFranzDEV/gitea-github-migrator is back up and states:

This repository got moved to the offical Gitea server and will be developed there. https://gitea.com/gitea/migrator/

I just tested it, it worked flawlessly (Debian 9/10)

apt update
apt install make golang go-dep git make
go get gitea.com/gitea/migrator
cd go/src/gitea.com/gitea/migrator
dep ensure -v
make build

sudo -u gitea ./gitea-github-migrator migrate --gh-repo my/project --gh-token $GITHUB_PERSONAL_TOKEN --url https://example.com/gitea --token $GITEA_API_TOKEN

Edit: limitation: doesn't import pull requests/release notes. Didn't create the project as "mirror" (no automatic pulls in the future).

Repository, issues, tags, wiki were imported correctly. Operation took 11 minutes on a github project with 1300 issues.

[techknowlogick]

For others coming to this issue, the migration functionality is now built into gitea itself.