Requires Python 2.7 ipykernel to be installed when opening Python 3 notebook

[ma137]

Environment data

• VS Code version: 1.53.2 (commit: 622cb03f7e070a9670c94bae1a45d78d7181fbd4)
• Jupyter Extension version (available under the Extensions sidebar): v2021.2.576440691
• Python Extension version (available under the Extensions sidebar): v2021.2.582707922
• OS and version: Ubuntu 20.04 (Linux x64 5.4.0-66-generic)
• Python and/or Anaconda version: Python 3.8.5 and Python 2.7.18
• Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A
• Jupyter server running: Local

Detailed VS Code version information:

Version: 1.53.2
Commit: 622cb03f7e070a9670c94bae1a45d78d7181fbd4
Date: 2021-02-11T11:48:44.518Z
Electron: 11.2.1
Chrome: 87.0.4280.141
Node.js: 12.18.3
V8: 8.7.220.31-electron.0
OS: Linux x64 5.4.0-66-generic

Expected behaviour

Start automatically the IPython kernel for the trusted Python 3 notebook while opening the notebook. Run cells after clicking on the "Run cell" button.

(Before updating VS Code everything worked as expected.)

Actual behaviour

Error message "Python 2.7.18 64-bit requires ipykernel to be installed." appears at startup and each time one tries to run a cell. Actually, the cells do not get executed until one closes the error message by clicking on the "x".

Steps to reproduce:

1. Start the Jupyter server by running jupyter notebook in a terminal. Open its web interface in a browser.
2. Create a new Python 3 notebook. Add a cell or more, e.g. a cell with 1+1.
3. Close the notebook in the web interface.
4. Start VS Code and open the notebook. Try to run the cell with the "Run cell" button.

Here is a part of the source of one of my notebooks. As far as I know, these metadata show clearly that it is
a Python 3 notebook.

 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.5-final"
  },
  "toc-autonumbering": true
 },
 "nbformat": 4,
 "nbformat_minor": 4
}

Logs

Output for Jupyter in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Jupyter)

> /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel" > /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel" Error 2021-02-24 20:00:40: Find kernel spec, Class name = L, completed in 40748ms, has a falsy return value, Arg 1: , Arg 2: {"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.5"}}, Arg 3: undefined, Arg 4: undefined, Return Value: undefined [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 } Error 2021-02-24 20:00:40: Get preferred local kernel connection, Class name = L, completed in 40749ms, has a falsy return value [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 } Error 2021-02-24 20:00:40: Failed to determine if a notebook is active for the current editor [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 } Error 2021-02-24 20:00:40: Failed to determine if a notebook is active for the current editor [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 } Error 2021-02-24 20:00:40: DataScience Error [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 } } Error 2021-02-24 20:01:20: Exception attempting to start notebook: [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 } Error 2021-02-24 20:01:20: DataScience Error [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python at L.installDependenciesIntoInterpreter (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:223195) at processTicksAndRejections (internal/process/task_queues.js:97:5) at async L.getKernelForLocalRawConnection (/home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/extension.js:1:222022)] { category: 'noipykernel', reason: 1 }

Possible origin of the problem

This output indicates that the problem might be that the extension executes /usr/bin/python also for Python 3 notebooks, while /usr/bin/python is actually Python 2 on Ubuntu 20.04. In the Ubuntu 20.04 release notes the following information can be found:

/usr/bin/python is not present by default on any new installs. On systems upgraded from previous releases, /usr/bin/python will continue to point to python2 for compatibility.

Screenshot

[rchiodo]

Thanks for the bug. What you said here is likely the root cause:

This output indicates that the problem might be that the extension executes /usr/bin/python also for Python 3 notebooks, while /usr/bin/python is actually Python 2 on Ubuntu 20.04. In the Ubuntu 20.04 release notes the following information can be found:

If you run jupyter kernelspec list --json what does your Python 3 kernelspec actually contain?

[ma137]

Thanks for the fast reply!

Here is the Python 3 kernelspec part of the output from jupyter kernelspec list --json:

  "kernelspecs": {
    "python3": {
      "resource_dir": "/usr/share/jupyter/kernels/python3", 
      "spec": {
        "interrupt_mode": "signal", 
        "display_name": "Python 3", 
        "env": {}, 
        "language": "python", 
        "argv": [
          "/usr/bin/python3", 
          "-m", 
          "ipykernel_launcher", 
          "-f", 
          "{connection_file}"
        ], 
        "metadata": {}
      }
    }, 

[ma137]

Here is another information that might be useful: Now, I installed version v2020.12.414227025 of vscode-jupyter. In this version everythings works as expected. So, I can definitively say that the bug was not yet present in version v2020.12.414227025.

[DonJayamanne]

@ma137
Please could you enable logging as follows:

• Open settings & go into Jupyter->Logging
• Change the value to debug
• Reload VS Code,
• Attempt to repro the issue & then copy the output from the Jupyter output panel.

The output would help us figure out what is going wrong. Thanks

[ma137]

I switched back to the current version of vscode-jupyter, i.e., v2021.2.576440691, and followed your instructions. You can find the log output below.

complete Jupyter log output from opening a Python 3 notebook (logging level is debug )

Info 2021-02-25 00:03:01: Checking if notebook is trusted
Info 2021-02-25 00:03:01: Trusted, Class name = p, completed in 2ms, has a truthy return value, Return Value: true
Info 2021-02-25 00:03:01: Loading web panel for file:///home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Loading webview. View is notset
Info 2021-02-25 00:03:01: Attempting to start a server because of preload conditions ...
Info 2021-02-25 00:03:01: Loading web view...
Info 2021-02-25 00:03:01: Webview panel created.
Info 2021-02-25 00:03:01: Creating raw notebook for file:///home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Getting preferred kernel for file:///home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Searching for kernel based on {"display_name":"Python 3","language":"python","name":"python3"} for /home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Find kernel spec, Class name = D, completed in 5ms, has a truthy return value, Arg 1: , Arg 2: {"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.5"}}, Arg 3: undefined, Return Value: {"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python3","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 3"}
Info 2021-02-25 00:03:01: Found matching interpreter based on interpreter or interpreterPath in metadata, for the kernel python3, Python 3, /usr/bin/python
Info 2021-02-25 00:03:01: Find matching interpreter for a given kernel spec, Class name = P, completed in 5ms, has a truthy return value, Arg 1: {"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python3","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 3"}, Arg 2: undefined, Return Value: {"architecture":3,"path":"/usr/bin/python","version":{"options":{"loose":false,"includePrerelease":false},"loose":false,"raw":"2.7.18-final","major":2,"minor":7,"patch":18,"prerelease":["final"],"build":[],"version":"2.7.18-final"},"sysVersion":"2.7.18 (default, Aug  4 2020, 11:16:42) \n[GCC 9.3.0]","sysPrefix":"/usr","fileHash":"56aa51cc7fb993a39110af62db9139888f06d1ef12380781ebcf13bfabf19e5b7d456d5bd96dd0796ceba8ff6beba8817eedc5371e4ba34128e15e9ac2c523bf","envType":"Unknown","displayName":"Python 2.7.18 64-bit"}
Info 2021-02-25 00:03:01: Found matching interpreter based on interpreter or interpreterPath in metadata, for the kernel python3, Python 3, /usr/bin/python
Info 2021-02-25 00:03:01: Find matching interpreter for a given kernel spec, Class name = P, completed in 6ms, has a truthy return value, Arg 1: {"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python3","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 3"}, Arg 2: undefined, Return Value: {"architecture":3,"path":"/usr/bin/python","version":{"options":{"loose":false,"includePrerelease":false},"loose":false,"raw":"2.7.18-final","major":2,"minor":7,"patch":18,"prerelease":["final"],"build":[],"version":"2.7.18-final"},"sysVersion":"2.7.18 (default, Aug  4 2020, 11:16:42) \n[GCC 9.3.0]","sysPrefix":"/usr","fileHash":"56aa51cc7fb993a39110af62db9139888f06d1ef12380781ebcf13bfabf19e5b7d456d5bd96dd0796ceba8ff6beba8817eedc5371e4ba34128e15e9ac2c523bf","envType":"Unknown","displayName":"Python 2.7.18 64-bit"}
Info 2021-02-25 00:03:01: installMissingDependencies /usr/bin/python
Info 2021-02-25 00:03:01: Cached data exists getEnvironmentVariables, 
Info 2021-02-25 00:03:01: Process Execution: > /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-02-25 00:03:01: Process Execution: > /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-02-25 00:03:02: Cached data exists getEnvironmentVariables, 
Info 2021-02-25 00:03:03: Web view react rendered
Info 2021-02-25 00:03:03: Request for onigasm file at /home/ma/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/out/client/node_modules/onigasm/lib/onigasm.wasm
Info 2021-02-25 00:03:03: Request for tmlanguage file.
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Searching for token colors ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Loading colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Attempting search for colors ...
Info 2021-02-25 00:03:03: Loading base colors from /home/ma/.vscode/extensions/zhuangtongfa.material-theme-3.9.15/themes/OneDark-Pro.json ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...
Info 2021-02-25 00:03:03: Using colors to generate CSS ...

an interesting part of the log (excerpt from the full log above)

Info 2021-02-25 00:03:01: Webview panel created.
Info 2021-02-25 00:03:01: Creating raw notebook for file:///home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Getting preferred kernel for file:///home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Searching for kernel based on {"display_name":"Python 3","language":"python","name":"python3"} for /home/ma/[...]/Untitled.ipynb
Info 2021-02-25 00:03:01: Find kernel spec, Class name = D, completed in 5ms, has a truthy return value, Arg 1: , Arg 2: {"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.5"}}, Arg 3: undefined, Return Value: {"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python3","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 3"}
Info 2021-02-25 00:03:01: Found matching interpreter based on interpreter or interpreterPath in metadata, for the kernel python3, Python 3, /usr/bin/python
Info 2021-02-25 00:03:01: Find matching interpreter for a given kernel spec, Class name = P, completed in 5ms, has a truthy return value, Arg 1: {"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python3","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 3"}, Arg 2: undefined, Return Value: {"architecture":3,"path":"/usr/bin/python","version":{"options":{"loose":false,"includePrerelease":false},"loose":false,"raw":"2.7.18-final","major":2,"minor":7,"patch":18,"prerelease":["final"],"build":[],"version":"2.7.18-final"},"sysVersion":"2.7.18 (default, Aug  4 2020, 11:16:42) \n[GCC 9.3.0]","sysPrefix":"/usr","fileHash":"56aa51cc7fb993a39110af62db9139888f06d1ef12380781ebcf13bfabf19e5b7d456d5bd96dd0796ceba8ff6beba8817eedc5371e4ba34128e15e9ac2c523bf","envType":"Unknown","displayName":"Python 2.7.18 64-bit"}
Info 2021-02-25 00:03:01: Found matching interpreter based on interpreter or interpreterPath in metadata, for the kernel python3, Python 3, /usr/bin/python
Info 2021-02-25 00:03:01: Find matching interpreter for a given kernel spec, Class name = P, completed in 6ms, has a truthy return value, Arg 1: {"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python3","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 3"}, Arg 2: undefined, Return Value: {"architecture":3,"path":"/usr/bin/python","version":{"options":{"loose":false,"includePrerelease":false},"loose":false,"raw":"2.7.18-final","major":2,"minor":7,"patch":18,"prerelease":["final"],"build":[],"version":"2.7.18-final"},"sysVersion":"2.7.18 (default, Aug  4 2020, 11:16:42) \n[GCC 9.3.0]","sysPrefix":"/usr","fileHash":"56aa51cc7fb993a39110af62db9139888f06d1ef12380781ebcf13bfabf19e5b7d456d5bd96dd0796ceba8ff6beba8817eedc5371e4ba34128e15e9ac2c523bf","envType":"Unknown","displayName":"Python 2.7.18 64-bit"}
Info 2021-02-25 00:03:01: installMissingDependencies /usr/bin/python
Info 2021-02-25 00:03:01: Cached data exists getEnvironmentVariables, 
Info 2021-02-25 00:03:01: Process Execution: > /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode/extensions/ms-toolsai.jupyter-2021.2.576440691/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"

[IanMatthewHuff]

@ma137 We just released a version of our insiders extension that I believe has the fix for your situation. If you download vscode-insiders (which works side by side with stable vscode, so it's easy to install and won't mess up your stable version) and install the jupyter extension can you try out this scenario again?

Also, in case it doesn't work could you please turn on the logging in vscode-insiders setting as above (insiders and stable use different settings stores) and attach the full log? We changed a lot of our kernel detection and launch code in this version, as well as updating the logging to give us more info on how the kernels are matching.

[DonJayamanne]

No longer an issue. Please feel free to create a new issue or re-open this issue if it persists.

[ma137]

@IanMatthewHuff I followed your instructions and installed VS Code Insiders. I installed the Python and the Jupyter extension therein. However, I keep getting the same error. (I hope I did it right. :-) ) You can find the version numbers and the logs (log level is set to debug) below.

Version numbers

• VS Code version: Version: 1.55.0-insider (commit: 8437d38d364ba93b53c1e659c20b1c86f710ec28 )
• Jupyter Extension version (available under the Extensions sidebar): v2021.4.678042391
• Python Extension version (available under the Extensions sidebar): v2021.3.680753044
• OS and version: Ubuntu 20.04 (Linux x64 5.4.0-70-generic)
• Python and/or Anaconda version: Python 3.8.5 and Python 2.7.18
• Type of virtual environment used (N/A | venv | virtualenv | conda | ...): N/A
• Jupyter server running: Local

Logs

complete Jupyter log output from opening a Python 3 notebook (logging level is debug)

User belongs to experiment group 'pythonJediLSP'
User belongs to experiment group 'jupyterTestcf'
User belongs to experiment group 'pythonDiscoveryModule'
User belongs to experiment group 'pythonFindInterpreter'
User belongs to experiment group 'NativeNotebookEditor'
Info 2021-03-24 23:09:15: ZMQ install verified.
Info 2021-03-24 23:09:15: Found existing keyfile at /home/ma/.config/Code - Insiders/User/globalStorage/ms-toolsai.jupyter/nbsecret
Info 2021-03-24 23:09:15: Checking if notebook is trusted
Info 2021-03-24 23:09:15: Check if Notebook is Trusted, Class name = p, completed in 3ms, has a truthy return value, Return Value: true
Info 2021-03-24 23:09:15: Attempting to start a server because of preload conditions ...
Info 2021-03-24 23:09:16: Search all interpreters /usr/bin/python, /usr/bin/python3
Info 2021-03-24 23:09:16: Loading kernelspec from /usr/share/jupyter/kernels/python3/kernel.json for /usr/bin/python
Info 2021-03-24 23:09:16: Loading kernelspec from /home/ma/.local/share/jupyter/kernels/python2/kernel.json for undefined
Info 2021-03-24 23:09:16: Cached data exists getEnvironmentVariables, 
Info 2021-03-24 23:09:16: Cached data exists getEnvironmentVariables, 
Info 2021-03-24 23:09:16: Cached data exists getEnvironmentVariables, 
Info 2021-03-24 23:09:16: Cached data exists getEnvironmentVariables, 
Info 2021-03-24 23:09:16: findPreferredKernel score for Python 2.7.18 64-bit is 3
Info 2021-03-24 23:09:16: findPreferredKernel score for Python 2 is 3
Info 2021-03-24 23:09:16: Find kernel spec, Class name = D, completed in 1ms, has a truthy return value, Arg 1: , Arg 2: {"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.8.5"}}, Arg 3: {"_isCancelled":false,"_emitter":null}, Return Value: {"kind":"startUsingPythonInterpreter","kernelSpec":{"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 2.7.18 64-bit"},"interpreter":{"sysPrefix":"/usr","envType":"Unknown","envName":"","envPath":"","path":"/usr/bin/python","architecture":3,"sysVersion":"2.7.18 (default, Mar  8 2021, 13:02:45) \n[GCC 9.3.0]","version":{"raw":"2.7.18","major":2,"minor":7,"patch":18,"build":[],"prerelease":[]},"displayName":"Python 2.7.18 64-bit"},"id":".python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90./usr/bin/python3./usr/bin/python.Python 2.7.18 64-bit"}
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py pip list
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py pip list
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py pip list
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py pip list
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import jupyter"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import jupyter"
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import jupyter"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import jupyter"
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import notebook"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import notebook"
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import notebook"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import notebook"
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-03-24 23:09:16: KernelProvider switched kernel to id = .python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90./usr/bin/python3./usr/bin/python.Python 2.7.18 64-bit}
Info 2021-03-24 23:09:16: Starting Notebook in kernel.ts id = .python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90./usr/bin/python3./usr/bin/python.Python 2.7.18 64-bit
Info 2021-03-24 23:09:16: Creating raw notebook for file:///home/ma/vscode_test/vscode_test.ipynb
Info 2021-03-24 23:09:16: Getting preferred kernel for file:///home/ma/vscode_test/vscode_test.ipynb
Info 2021-03-24 23:09:16: Computing working directory file:///home/ma/vscode_test/vscode_test.ipynb
Info 2021-03-24 23:09:16: Connecting to raw session for file:///home/ma/vscode_test/vscode_test.ipynb with connection {"kind":"startUsingPythonInterpreter","kernelSpec":{"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 2.7.18 64-bit"},"interpreter":{"sysPrefix":"/usr","envType":"Unknown","envName":"","envPath":"","path":"/usr/bin/python","architecture":3,"sysVersion":"2.7.18 (default, Mar  8 2021, 13:02:45) \n[GCC 9.3.0]","version":{"raw":"2.7.18","major":2,"minor":7,"patch":18,"build":[],"prerelease":[]},"displayName":"Python 2.7.18 64-bit"},"id":".python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90./usr/bin/python3./usr/bin/python.Python 2.7.18 64-bit"}
Info 2021-03-24 23:09:16: Starting raw kernel Python 2.7.18 64-bit
Info 2021-03-24 23:09:16: installMissingDependencies /usr/bin/python
Info 2021-03-24 23:09:16: Cached data exists getEnvironmentVariables, 
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-03-24 23:09:16: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Error 2021-03-24 23:09:16: Install Missing Dependencies, Class name = v, completed in 345ms, has a falsy return value, Return Value: undefined [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)] {
  category: 'noipykernel',
  reason: 1
}
Error 2021-03-24 23:09:16: Raw session failed to start because dependencies not installed
Info 2021-03-24 23:09:16: Shutdown session -- complete
Error 2021-03-24 23:09:16: failed to create INotebook in kernel, UI Disabled = true [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)] {
  category: 'noipykernel',
  reason: 1
}
Error 2021-03-24 23:09:16: failed to start INotebook in kernel, UI Disabled = true [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)] {
  category: 'noipykernel',
  reason: 1
}
Info 2021-03-24 23:09:28: Execute Cell 0 file:///home/ma/vscode_test/vscode_test.ipynb in kernelWithMetadata.ts
Info 2021-03-24 23:09:28: Starting Notebook in kernel.ts id = .python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90./usr/bin/python3./usr/bin/python.Python 2.7.18 64-bit
Info 2021-03-24 23:09:28: Cell Index:0, state:undefined, exec: 1. User queued cell for execution
Info 2021-03-24 23:09:28: Cell Index:0, state:undefined, exec: 1. Update cell state as it was enqueued
Info 2021-03-24 23:09:28: Creating raw notebook for file:///home/ma/vscode_test/vscode_test.ipynb
Info 2021-03-24 23:09:28: Getting preferred kernel for file:///home/ma/vscode_test/vscode_test.ipynb
Info 2021-03-24 23:09:28: Computing working directory file:///home/ma/vscode_test/vscode_test.ipynb
Info 2021-03-24 23:09:28: Connecting to raw session for file:///home/ma/vscode_test/vscode_test.ipynb with connection {"kind":"startUsingPythonInterpreter","kernelSpec":{"specFile":"/usr/share/jupyter/kernels/python3/kernel.json","interpreterPath":"/usr/bin/python","name":"python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90","argv":["/usr/bin/python3","-m","ipykernel_launcher","-f","{connection_file}"],"language":"python","path":"/usr/bin/python3","display_name":"Python 2.7.18 64-bit"},"interpreter":{"sysPrefix":"/usr","envType":"Unknown","envName":"","envPath":"","path":"/usr/bin/python","architecture":3,"sysVersion":"2.7.18 (default, Mar  8 2021, 13:02:45) \n[GCC 9.3.0]","version":{"raw":"2.7.18","major":2,"minor":7,"patch":18,"build":[],"prerelease":[]},"displayName":"Python 2.7.18 64-bit"},"id":".python2718jvsc74a57bd0767d51c1340bd893661ea55ea3124f6de3c7a262a8b4abca0554b478b1e2ff90./usr/bin/python3./usr/bin/python.Python 2.7.18 64-bit"}
Info 2021-03-24 23:09:28: Starting raw kernel Python 2.7.18 64-bit
Info 2021-03-24 23:09:28: installMissingDependencies /usr/bin/python
Info 2021-03-24 23:09:28: Cached data exists getEnvironmentVariables, 
Info 2021-03-24 23:09:28: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-03-24 23:09:28: Process Execution: > /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
> /usr/bin/python ~/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/pythonFiles/pyvsc-run-isolated.py -c "import ipykernel"
Info 2021-03-24 23:09:29: Trusting notebook...
Info 2021-03-24 23:09:29: Wrote trust for file:///home/ma/vscode_test/vscode_test.ipynb to /home/ma/.config/Code - Insiders/User/globalStorage/ms-toolsai.jupyter/nbsignatures/66c3e7a4fccbd120adcd6c45581d0ecec16d04aeebacc7422c5be4f4fe05c443
Error 2021-03-24 23:09:53: Install Missing Dependencies, Class name = v, completed in 24845ms, has a falsy return value, Return Value: undefined [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)
	at processTicksAndRejections (internal/process/task_queues.js:97:5)] {
  category: 'noipykernel',
  reason: 1
}
Error 2021-03-24 23:09:53: Raw session failed to start because dependencies not installed
Info 2021-03-24 23:09:53: Shutdown session -- complete
Error 2021-03-24 23:09:53: failed to create INotebook in kernel, UI Disabled = false [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)
	at processTicksAndRejections (internal/process/task_queues.js:97:5)] {
  category: 'noipykernel',
  reason: 1
}
Error 2021-03-24 23:09:53: DataScience Error [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)
	at processTicksAndRejections (internal/process/task_queues.js:97:5)] {
  category: 'noipykernel',
  reason: 1
}
Error 2021-03-24 23:09:53: failed to start INotebook in kernel, UI Disabled = false [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)
	at processTicksAndRejections (internal/process/task_queues.js:97:5)] {
  category: 'noipykernel',
  reason: 1
}
Error 2021-03-24 23:09:53: Failed to execute cells in CellExecutionQueue [a [Error]: IPyKernel not installed into interpreter Python 2.7.18 64-bit:/usr/bin/python
	at v.installMissingDependencies (/home/ma/.vscode-insiders/extensions/ms-toolsai.jupyter-2021.4.678042391/out/client/extension.js:49:560207)
	at processTicksAndRejections (internal/process/task_queues.js:97:5)] {
  category: 'noipykernel',
  reason: 1
}
Info 2021-03-24 23:09:53: Cancel pending cells
Info 2021-03-24 23:09:53: Cell Index:0, state:2, exec: undefined. Execution cancelled
Info 2021-03-24 23:09:53: Cell Index:0, state:2, exec: undefined. Completed due to cancellation
Info 2021-03-24 23:09:53: Cell Index:0, state:2, exec: undefined. Update cell status as idle and message as empty
Info 2021-03-24 23:09:53: Cell Index:0, state:2, exec: undefined. Cell cancelled & resolving
Info 2021-03-24 23:09:53: Cell Index:0, state:2, exec: undefined. Execution disposed
Info 2021-03-24 23:09:54: Trusting notebook...

To the following three lines, which are contained the full log above, seem to be especially interesting:

Info 2021-03-24 23:09:16: Search all interpreters /usr/bin/python, /usr/bin/python3
Info 2021-03-24 23:09:16: Loading kernelspec from /usr/share/jupyter/kernels/python3/kernel.json for /usr/bin/python
Info 2021-03-24 23:09:16: Loading kernelspec from /home/ma/.local/share/jupyter/kernels/python2/kernel.json for undefined

[IanMatthewHuff]

Actually this bit here might be the interesting bit:

Info 2021-03-24 23:09:16: Loading kernelspec from /usr/share/jupyter/kernels/python3/kernel.json for /usr/bin/python
Info 2021-03-24 23:09:16: Loading kernelspec from /home/ma/.local/share/jupyter/kernels/python2/kernel.json for undefined
...
Info 2021-03-24 23:09:16: findPreferredKernel score for Python 2.7.18 64-bit is 3
Info 2021-03-24 23:09:16: findPreferredKernel score for Python 2 is 3

At this point we look at the info in the metadata of the notebook file to see the best kernel match on the system. And we look for any python interpreters or kernelspecs available on the system to launch with.

That python3 kernelspec that you have installed seems to be getting mapped to that /usr/bin/python python2. Given that the kernelspec has

Sorry to be asking so much of you, but I can't seem to generate this same scenario myself locally. This time could you set the setting Python->Logging->Level to debug and rerun the scenario? And this time pull the log from the Python output instead of the Jupyter output? The error here seems to be that when looking at the /usr/bin/python interpreter (we rely on the Python extension for getting interpreter info) we are associating it with that python3 kernelspec. With that python info I should be able to see the interpreter info for all the interpreters getting passed via the python extension.