after install, error on import

[kr0b3rts]

Picking up from email as requested ....

Here is the traceback. The exception occurs on the import pydoxtools step

Traceback (most recent call last):
File "testpydox.py", line 1, in
import pydoxtools as pdx
File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/init.py", line 9, in
from .document import Document, DocumentBag, DatabaseSource
File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/document.py", line 25, in
from . import dask_operators
File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/dask_operators.py", line 12, in
from .document_base import Pipeline
File "/home/kroberts/dev/chat/lib/python3.8/site-packages/pydoxtools/document_base.py", line 239, in
class DocumentLocation(pydantic.BaseModel):
File "pydantic/main.py", line 178, in pydantic.main.ModelMetaclass.new
File "pydantic/typing.py", line 400, in pydantic.typing.resolve_annotations

File "/usr/lib/python3.8/typing.py", line 270, in _eval_type
return t._evaluate(globalns, localns)
File "/usr/lib/python3.8/typing.py", line 518, in _evaluate
eval(self.forward_code, globalns, localns),
File "", line 1, in
TypeError: 'type' object is not subscriptable

[yeus]

ok, thank you for the error log. I suspect its because of the python3.8 version you're using. Python 3.10 works much better with pydoxtools. Let me check that and see if I can reproduce the error!

[yeus]

yes. working on removing some of the python3.10 dependencies...

[kr0b3rts]

Thanks. My environment may need some cleanup as well. i attempted to create a venv and install 3.10, but was then having issues in that venv getting pip to work to even run the install! (This is Ubuntu 20.04 in WSL ... what could go wrong? ;-) Ken

…

On Fri, Sep 8, 2023 at 2:57 PM Thomas Meschede ***@***.***> wrote: yes. working on removing some of the python3.10 dependencies... — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A6JP6FRKEZ4JLRWEFZ2V3MTXZOIDFANCNFSM6AAAAAA4NUQ5IE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- -------------------------------------- ***@***.*** ***@***.***>

[kr0b3rts]

I keep trying to install. getting hung on pygraphviz/graphviz_wrap.c:168:11: fatal error: Python.h: No such file or directory 168 | # include <Python.h> | ^~~~~~~~~~ compilation terminated. error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1 [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for pygraphviz

…

On Fri, Sep 8, 2023 at 3:15 PM Ken Roberts ***@***.***> wrote: Thanks. My environment may need some cleanup as well. i attempted to create a venv and install 3.10, but was then having issues in that venv getting pip to work to even run the install! (This is Ubuntu 20.04 in WSL ... what could go wrong? ;-) Ken On Fri, Sep 8, 2023 at 2:57 PM Thomas Meschede ***@***.***> wrote: > yes. working on removing some of the python3.10 dependencies... > > — > Reply to this email directly, view it on GitHub > <#1 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/A6JP6FRKEZ4JLRWEFZ2V3MTXZOIDFANCNFSM6AAAAAA4NUQ5IE> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> > -- -------------------------------------- ***@***.*** ***@***.***>

-- -------------------------------------- ***@***.*** ***@***.***>

[kr0b3rts]

okay, got past the Python.h issue. (needed sudo apt-get install libpython3.10-dev) Now the following on import. any quick pointers to what is missing $ python3 Python 3.10.13 (main, Aug 25 2023, 13:20:03) [GCC 9.4.0] on linux Type "help", "copyright", "credits" or "license" for more information.

>> import pydoxtools as pdx

installed pandoc version 2.5, which doesn't support rtf file format!in order to be able to use rtf, you need to install a pandoc version >= 2.14.2Checkout this link here: https://github.com/jgm/pandoc/releases/tag/2.19.2 Traceback (most recent call last): File "<stdin>", line 1, in <module> File "/home/kroberts/.local/lib/python3.10/site-packages/pydoxtools/__init__.py", line 9, in <module> from .document import Document, DocumentBag, DatabaseSource File "/home/kroberts/.local/lib/python3.10/site-packages/pydoxtools/document.py", line 640, in <module> f"Currently available models are: {extract_nlpchat.gpt4_models()}" File "/home/kroberts/.local/lib/python3.10/site-packages/pydoxtools/extract_nlpchat.py", line 71, in gpt4_models from gpt4all import GPT4All File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/__init__.py", line 1, in <module> from .gpt4all import Embed4All, GPT4All # noqa File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/gpt4all.py", line 13, in <module> from . import pyllmodel File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/pyllmodel.py", line 48, in <module> llmodel = load_llmodel_library() File "/home/kroberts/.local/lib/python3.10/site-packages/gpt4all/pyllmodel.py", line 43, in load_llmodel_library llmodel_lib = ctypes.CDLL(llmodel_dir) File "/usr/lib/python3.10/ctypes/__init__.py", line 374, in __init__ self._handle = _dlopen(self._name, mode) OSError: /lib/x86_64-linux-gnu/libstdc++.so.6: version `GLIBCXX_3.4.29' not found (required by /home/kroberts/.local/lib/python3.10/site-packages/gpt4all/llmodel_DO_NOT_MODIFY/build/libllmodel.so) On Mon, Sep 18, 2023 at 3:37 PM Ken Roberts ***@***.***> wrote:

…

I keep trying to install. getting hung on pygraphviz/graphviz_wrap.c:168:11: fatal error: Python.h: No such file or directory 168 | # include <Python.h> | ^~~~~~~~~~ compilation terminated. error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1 [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building wheel for pygraphviz On Fri, Sep 8, 2023 at 3:15 PM Ken Roberts ***@***.***> wrote: > Thanks. > My environment may need some cleanup as well. i attempted to create a > venv and install 3.10, but was then having issues in that venv getting pip > to work to even run the install! (This is Ubuntu 20.04 in WSL ... what > could go wrong? ;-) > Ken > > On Fri, Sep 8, 2023 at 2:57 PM Thomas Meschede ***@***.***> > wrote: > >> yes. working on removing some of the python3.10 dependencies... >> >> — >> Reply to this email directly, view it on GitHub >> <#1 (comment)>, >> or unsubscribe >> <https://github.com/notifications/unsubscribe-auth/A6JP6FRKEZ4JLRWEFZ2V3MTXZOIDFANCNFSM6AAAAAA4NUQ5IE> >> . >> You are receiving this because you authored the thread.Message ID: >> ***@***.***> >> > > > -- > -------------------------------------- > ***@***.*** ***@***.***> > -- -------------------------------------- ***@***.*** ***@***.***>

-- -------------------------------------- ***@***.*** ***@***.***>

[yeus]

hm... interesting error I haven't seen this one before. Does this one here help you?

https://stackoverflow.com/questions/65349875/where-can-i-find-glibcxx-3-4-29

Things have progress, so I am searching for alternatives to gpt4all right now though. I hope the hf transformers library will get to a point where it can run the local quantized models out-of-the-box

[kr0b3rts]

i recently got a new system, so i'll try this in a much fresher environment soon!

…

On Fri, Jan 12, 2024 at 9:57 AM Thomas Meschede ***@***.***> wrote: hm... interesting error I haven't seen this one before. Does this one here help you? https://stackoverflow.com/questions/65349875/where-can-i-find-glibcxx-3-4-29 Things have progress, so I am searching for alternatives to gpt4all right now though. I hope the hf transformers library will get to a point where it can run the local quantized models out-of-the-box — Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/A6JP6FSDDT5XQUCEFBV72NTYOF2QXAVCNFSM6AAAAAA4NUQ5IGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQOBZG4ZDONBQGQ> . You are receiving this because you authored the thread.Message ID: ***@***.***>

-- -------------------------------------- ***@***.*** ***@***.***>

[yeus]

just released a new version. maybe it works better now! I updated a lot of the dependencies...