This can get you a part of the way, extracted from my PowerShell profile:

    ##
    # PSReadLine, see https://github.com/PowerShell/PSReadLine
    ##

    ## behaviour of Tab key autocomplete
    Set-PSReadlineKeyHandler -Key Tab -Function MenuComplete
    ## From docs:
    ## With these bindings, up arrow/down arrow will work like PowerShell/cmd if the
    ## current command line is blank. If you've entered some text though, it will
    ## search the history for commands that start with the currently entered text.
    ##
    ## Like zsh completion.
    Set-PSReadLineKeyHandler -Key UpArrow -Function HistorySearchBackward
    Set-PSReadLineKeyHandler -Key DownArrow -Function HistorySearchForward

These will allow you to autocomplete previous commands from the tidpids you already types, so it no longer searches linearly through the history. I also use:

    Import-Module posh-git
    Import-Module oh-my-posh
    Set-Theme Agnoster

Do you happen to have your PowerShell profile in a GitHub Gist or so?

No, but mostly because it is not much longer than the above! Only got started using PowerShell more seriously (thanks to Windows Terminal and WSL) a couple of months ago.

Here is the other content:

  # For Agnoster theme, "user@host" will be hidden if user==DefaultUser
  $DefaultUser = "<YOUR USERNAME>"

  function vim ($File){
      bash -c "vim $File"
  }

  New-Alias pi ipython

  # git diff output uses less; it will be buggy without utf8
  $env:LESSCHARSET='UTF-8'

  # console output, e.g, when writing git diff output to file using pipe: | Out-File
  [Console]::OutputEncoding = [System.Text.Encoding]::UTF8

Is using WSL an option for you? I'm using oh-my-zsh with it just fine.

Without GPU support, not much.