Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue with running Bazel tests #87

Open
chinmayrane opened this issue Jan 16, 2023 · 2 comments
Open

Issue with running Bazel tests #87

chinmayrane opened this issue Jan 16, 2023 · 2 comments

Comments

@chinmayrane
Copy link

I did try run from tf_quant_finance directory as well, am I missing something here, surely seems like a path/ pythonpath issue.
Did see in bazel that they remove the sys.path[0], not sure if that's the reason. https://github.com/bazelbuild/bazel/blob/master/tools/python/python_bootstrap_template.txt#L19

Tried to add it to the PYTHONPATH variable as well, but didn't have any luck.

C:\GitRepos\tf-quant-finance (master -> origin)
(tqf) λ bazel test //tf_quant_finance/math/random_ops/sobol:sobol_test
INFO: Analyzed target //tf_quant_finance/math/random_ops/sobol:sobol_test (1 packages loaded, 2 targets configured).
INFO: Found 1 test target...
FAIL: //tf_quant_finance/math/random_ops/sobol:sobol_test (see C:/users/ch/_bazel_ch/ssh2zpbu/execroot/tf_quant_finance/bazel-out/x64_windows-fastbuild/testlogs/tf_quant_finance/math/random_ops/sobol/sobol_test/test.log)
Target //tf_quant_finance/math/random_ops/sobol:sobol_test up-to-date:
  bazel-bin/tf_quant_finance/math/random_ops/sobol/sobol_test.exe
  bazel-bin/tf_quant_finance/math/random_ops/sobol/sobol_test.zip
INFO: Elapsed time: 7.009s, Critical Path: 6.66s
INFO: 2 processes: 2 local.
INFO: Build completed, 1 test FAILED, 2 total actions
//tf_quant_finance/math/random_ops/sobol:sobol_test                      FAILED in 6.6s
  C:/users/ch/_bazel_ch/ssh2zpbu/execroot/tf_quant_finance/bazel-out/x64_windows-fastbuild/testlogs/tf_quant_finance/math/random_ops/sobol/sobol_test/test.log

Executed 1 out of 1 test: 1 fails locally.

Contains of the log file

-----------------------------------------------------------------------------
Traceback (most recent call last):
  File "C:\Users\ch\AppData\Local\Temp\Bazel.runfiles_ue9zden8\runfiles\tf_quant_finance\tf_quant_finance\math\random_ops\sobol\sobol_test.py", line 22, in <module>
    from tf_quant_finance.math import random
ModuleNotFoundError: No module named 'tf_quant_finance.math'
@cyrilchim
Copy link
Contributor

Sorry for the late reply. I'd need to reproduce the issue. Could you please let me know what bazel version you are using?

Could you please specify the environment you are using? Are you running it on Windows?

@chinmayrane
Copy link
Author

chinmayrane commented Jan 24, 2023

No problem, thank you for responding.

Bazel Version - 6.0.0

λ bazel version
Starting local Bazel server and connecting to it...
Build label: 6.0.0
Build target: bazel-out/x64_windows-opt/bin/src/main/java/com/google/devtools/build/lib/bazel/BazelServer_deploy.jar
Build time: Mon Dec 19 15:54:13 2022 (1671465253)
Build timestamp: 1671465253
Build timestamp as int: 1671465253

And yes, running it on windows.

environment ->

# packages in environment at C:\Miniconda3\envs\tqf:
#
# Name                    Version                   Build  Channel
absl-py                   1.4.0                    pypi_0    pypi
astunparse                1.6.3                    pypi_0    pypi
attrs                     22.1.0           py38haa95532_0
blas                      1.0                         mkl
bottleneck                1.3.5            py38h080aedc_0
ca-certificates           2022.10.11           haa95532_0
cachetools                5.2.1                    pypi_0    pypi
certifi                   2022.12.7        py38haa95532_0
charset-normalizer        3.0.1                    pypi_0    pypi
cloudpickle               2.2.0                    pypi_0    pypi
decorator                 5.1.1                    pypi_0    pypi
dm-tree                   0.1.8                    pypi_0    pypi
flatbuffers               23.1.4                   pypi_0    pypi
gast                      0.4.0                    pypi_0    pypi
google-auth               2.16.0                   pypi_0    pypi
google-auth-oauthlib      0.4.6                    pypi_0    pypi
google-pasta              0.2.0                    pypi_0    pypi
grpcio                    1.51.1                   pypi_0    pypi
h5py                      3.7.0                    pypi_0    pypi
idna                      3.4                      pypi_0    pypi
importlib-metadata        6.0.0                    pypi_0    pypi
intel-openmp              2021.4.0          haa95532_3556
jax                       0.4.1                    pypi_0    pypi
keras-nightly             2.12.0.dev2023011608          pypi_0    pypi
libclang                  15.0.6.1                 pypi_0    pypi
libffi                    3.4.2                hd77b12b_6
markdown                  3.4.1                    pypi_0    pypi
markupsafe                2.1.1                    pypi_0    pypi
mkl                       2021.4.0           haa95532_640
mkl-service               2.4.0            py38h2bbff1b_0
mkl_fft                   1.3.1            py38h277e83a_0
mkl_random                1.2.2            py38hf11a4ad_0
numexpr                   2.8.4            py38h5b0cc5e_0
numpy                     1.23.5           py38h3b20f71_0
numpy-base                1.23.5           py38h4da318b_0
oauthlib                  3.2.2                    pypi_0    pypi
openssl                   1.1.1s               h2bbff1b_0
opt-einsum                3.3.0                    pypi_0    pypi
packaging                 22.0             py38haa95532_0
pandas                    1.5.2            py38hf11a4ad_0
pip                       22.3.1           py38haa95532_0
protobuf                  3.19.6                   pypi_0    pypi
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
python                    3.8.15               h6244533_2
python-dateutil           2.8.2              pyhd3eb1b0_0
pytz                      2022.7           py38haa95532_0
requests                  2.28.2                   pypi_0    pypi
requests-oauthlib         1.3.1                    pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
scipy                     1.10.0                   pypi_0    pypi
setuptools                65.6.3           py38haa95532_0
six                       1.16.0             pyhd3eb1b0_1
sqlite                    3.40.1               h2bbff1b_0
tb-nightly                2.12.0a20230116          pypi_0    pypi
tensorboard-data-server   0.6.1                    pypi_0    pypi
tensorboard-plugin-wit    1.8.1                    pypi_0    pypi
tensorflow-io-gcs-filesystem 0.29.0                   pypi_0    pypi
tensorflow-probability    0.12.1                   pypi_0    pypi
termcolor                 2.2.0                    pypi_0    pypi
tf-estimator-nightly      2.12.0.dev2023010909          pypi_0    pypi
tf-nightly                2.12.0.dev20230116          pypi_0    pypi
tf-nightly-intel          2.12.0.dev20230116          pypi_0    pypi
typing-extensions         4.4.0                    pypi_0    pypi
urllib3                   1.26.14                  pypi_0    pypi
vc                        14.2                 h21ff451_1
vs2015_runtime            14.27.29016          h5e58377_2
werkzeug                  2.2.2                    pypi_0    pypi
wheel                     0.37.1             pyhd3eb1b0_0
wincertstore              0.2              py38haa95532_2
wrapt                     1.14.1                   pypi_0    pypi
zipp                      3.11.0                   pypi_0    pypi

Conda Info

     active environment : tqf
    active env location : C:\Miniconda3\envs\tqf
            shell level : 1
       user config file : C:\Users\chinm\.condarc
 populated config files : C:\Users\chinm\.condarc
          conda version : 22.11.1
    conda-build version : not installed
         python version : 3.8.5.final.0
       virtual packages : __archspec=1=x86_64
                          __win=0=0
       base environment : C:\Miniconda3  (writable)
      conda av data dir : C:\Miniconda3\etc\conda
  conda av metadata url : None
           channel URLs : https://repo.anaconda.com/pkgs/main/win-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/win-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/msys2/win-64
                          https://repo.anaconda.com/pkgs/msys2/noarch
          package cache : C:\Miniconda3\pkgs
                          C:\Users\chinm\.conda\pkgs
                          C:\Users\chinm\AppData\Local\conda\conda\pkgs
       envs directories : C:\Miniconda3\envs
                          C:\Users\chinm\.conda\envs
                          C:\Users\chinm\AppData\Local\conda\conda\envs
               platform : win-64
             user-agent : conda/22.11.1 requests/2.28.1 CPython/3.8.5 Windows/10 Windows/10.0.22621
          administrator : False
             netrc file : None
           offline mode : False

Attached is my environment yaml - environment.yml.txt Just change the name to ennvironment.yml from environment.yml.txt if that helps. If windows is a hard dependency, I can try to build it from WSL on Visual Studio.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants