Plan of Gitea v1.16

[lunny]

Hi all Gitea contributors,

Gitea 1.15rc1 will be out sooner (🎉!) and after that we will create a new branch for 1.16 development. As mentioned in our CONTRIBUTION, it will spend three or four months before feature freeze.

I'm aware now is the time for the regular planning thread. Please use it to discuss your own plans for the 1.16 development cycle.

(Reminder, this thread is for things you PLAN TO DO YOURSELF, not things you want other people to do.)

Thanks,
Lunny

[lunny]

I plan to finish some of my previous PRs at first,

• Support pagination of organizations on user settings pages #16083
• Extract api for UI from api v1 routes and remove session dependent for API/v1 #16052
• WIP: remove unused user fields #15398
• WIP: Support new file/upload file buttons on empty repo home page #6918

And I also want to resolve the problems when migrating Gitea from Github to gitea.com .

If I have more time, I would like to try to support Github actions on Gitea.

[zeripath]

Authentication/Authorization refactors

models/login_source needs to be simplified and we need to make authentication and authorization a bit clearer.

• Refactor: Move login out of models #16199 is the beginning of this and following on from this I intend to look at Oauth providers a bit to make adding additional ones a lot simpler. I suspect we can prevent the creation of these goth users etc.
• Following on from Refactor: Move login out of models #16199 I think we should be able to make it possible to create and use OAuth tokens with restricted permissions. This would require a clearer idea of context and permissions but it's something we need to do.
• Send registration email on user autoregistration #16523 follows on from this and allows the sending of notification emails on autoregister.
• Add microsoft oauth2 providers #16544 also follows on from this and adds support for Azure and other MS Oauth providers - in doing so providers have been slightly refactored.
• Add setting to OAuth handlers to skip local 2FA authentication #16594
  • Following on from this I've extended this to LDAP, SMTP, and PAM sources.
  • Make LDAP be able to skip local 2FA #16954
  • Add SkipLocal2FA option to pam and smtp sources #17078
• Add Option to synchronize Admin & Restricted states from OIDC/OAuth2 along with Setting Scopes #16766
• Allow LDAP Sources to provide Avatars #16851

This is likely to represent a large refactoring series with multiple PRs and will probably represent the bulk of the things.

(It's worth noting that although this may appear orthogonal to things like federation - this is key to making federation possible.)

• I should probably look at oAuth / openID with skip-tls-verify #16376 once the above PR is in. (This appears to be a configuration issue.)

Rendering repositories

• Now we pass a context in to get last commit we can give the last commit generator a deadline and make it return what it has found within that deadline. A simple solution would then refresh the page to find the missing entries but if we paged the repository viewer we could actually make things a lot quicker there too.

• Add directory paging for rendering code trees #16432 adds paging to the directory rendering meaning repos with large directories get paged.

• Defer Last Commit Info #16467 represents a PR that will allow last commit generation to be aborted to render the page quicker.

• WIP: Defer last commit info #16063 represents an alternative earlier idea using an unique queue to defer last commit generation. I think this isn't going to completely work but it's showing at least part of the idea. We may want to revisit the unique queue generation aspect though.

Diff generation

It's way past time we improve this.

My work on 1.15 was massively derailed by the git and go-git problems so this might actually finally pop to the top of the list again.

I've got three four PRs ready at this:

• Simplify split diff view generation and remove JS dependency #16775
• Support direct comparison (git diff a..b) as well merge comparison (a…b) #16635
• Use git attributes to determine generated and vendored status for language stats and diffs #16773
• Add buttons to allow loading of incomplete diffs #16829

I have some code that will allow you to request specific files to be diffed but it's dependent on #16775.

Once #16773 is in I can add in support for linguist-language to diffs.

We then couple the per-file diff with #16773 and a small amount of other work and we get a way of avoiding creating diffs for vendored files etc.

Caching

Now we have a memory cache implementation (twoqueue) that is not unbounded in the number of objects it will and can store we can consider caching more things. A good candidate could be commit verification as the cache invalidation is predictable.

It's likely that the simplistic solution within twoqueue may need further optimization as people try it - but hopefully we'll be able to consider it ready to make it the default for 1.16. Another thing is that it may be helpful to consider having a two level cache.

Queues

• We still need to merge/consider the Pause Queues PR Pause queues #15928. This is likely to be very important for users of things like elasticsearch which may stop or start.

Organization Remove/Leave Modals

• Add modals to Organization and Team remove/leave #16471 These unfortunately didn't get in to 1.15 but I think they're sufficiently annoying that I've just added a PR to add these

[jolheiser]

Existing PRs

• Add pre-receive hook to check for email privacy #14686
• Add bundle download for repository #14538
  • Another PR after this that uses bundles instead of bare repos in archives
• Protected branches with templates #14334

Other plans

• Webhook External Command #14693
• Continue working on OpenGraph image implementation
• Possibly Feature proposal: profile readmes #12233

[lafriks]

Automatically pause queues if Elastic becomes unavailable and viceversa

• Automatically pause queue if index service is unavailable #15066 (based on @zeripath pausable queues Pause queues #15928)

Secrets storage

• Add Gitea secrets storage and management #14483

Advanced labels with priority

• Add advanced labels with priority #11669

CI integration into Gitea UI

• GitLab runner
• Woodpecker runner

[a1012112796]

Existing PRs

• Add agit flow support in gitea #14295
• Add a simple way to rename branch like gh #15870
• Add option to update pull request by rebase #16125
• reply issue by email #13585

[kolaente]

I hope to finally find the time to work on these two:

• Auto merge pull requests when all checks succeeded via API #9307
• Notify about recent pushes if a branch has no PR yet #14003.

[richmahn]

Having got into CSV/TSV for my company and how they render, I noticed a lot of bugs, which I created issues for last week. Will at least be fixing those, and back porting to v1.15.X if needed.

[techknowlogick]

For this milestone, the two things I am for sure working on are:

• Feature Request: Implement Nodeinfo endpoints for federation discovery #16758
• Feature request: Create keypair per user for signing federated requests #16717

these are two required things for joining the fediverse.

[wxiaoguang]

I am investigating:

Admin user list filter

• Add user status filter to admin user management page #16770 Merged

Issue / Comment content history

• Save and view issue/comment content history #16909 Merged
  • Issue/comment edit history #12886
  • Implement comments/issue/other texts history #5255

(actually they are the same one)

Two-factor authencation

• (Discontinued) Enforce two-factor authentication #16880
  • Ability to enforce two-factor authentication #880 , I think a global setting in app.ini is enough for most people, just like what GitLab does. And it's better to keep things simple enough. More thoughts: if there is an option for login sources to indicate the 2FA requirement, it would be better. eg: OAuth2 skips local 2FA, LDAP requires local 2FA, SPNEGO can use local 2FA optionally.

Frontend refactor

• Frontend Plan #17149 Basic work has been done. Future works need new separate PR.

[vwbusguy]

These are some low hanging fruit that have been asked for over several releases that I'd love to see picked up:

• WIP: wiki - page toc and directory support #7225
• WIP: wiki - add toc to wiki pages and rendered md files #7182
• TOC for Wiki Pages #822