Problems with setting up Khoj for obsidian

[MordechaiHadad]

For some reason the llama model isn't indexing my vault.

I have llama successfully downloaded and install. installed the khoj plugin, and forced vault indexing and i got this:

[11:06:52] INFO     🔍 📜 Setting up text search model                                                  configure.py:146
           INFO     🔍 🌄 Setting up image search model                                                 configure.py:150
[11:06:54] WARNING  🚨 No Content configuration available.                                              configure.py:165
           INFO     📬 Search models, Conversation processor updated via API                                  api.py:600
           INFO     127.0.0.1:52298 - "GET /api/update?t=pdf&force=true&client=obsidian HTTP/1.1" 200    h11_impl.py:431

When i try to chat with it about my notes i get this error:

[11:07:54] INFO     127.0.0.1:52330 - "GET /api/chat/history?client=obsidian HTTP/1.1" 200               h11_impl.py:431
[11:08:03] WARNING  No content index loaded, so cannot extract references from knowledge base. Please         api.py:710
                    configure your data sources and update the index to chat with your notes.
           INFO     127.0.0.1:52334 - "GET                                                               h11_impl.py:431
                    /api/chat?q=what%20is%20my%20todo%20for%20today&n=6&client=obsidian&stream=true
                    HTTP/1.1" 200

What is causing this issue?

[sabaimran]

Hey @MordechaiHadad , thanks for raising an issue.

When you started obsidian, did you see it generate any logs that indicated it was indexing the files? When you use the search model, do you see any results come up?

The logs indicate that you may not have any data indexed yet.

[MordechaiHadad]

when I start obsidian I get this error:

But I think it's okay since, once i go to khoj plugin settings it says that it's connected to the backend.
and the logs are:

[11:29:06] INFO     127.0.0.1:53068 - "GET /api/config/data HTTP/1.1" 200                                h11_impl.py:431
           INFO     127.0.0.1:53068 - "GET /api/config/data/default HTTP/1.1" 200                        h11_impl.py:431
           INFO     127.0.0.1:53068 - "GET /api/config/data HTTP/1.1" 200                                h11_impl.py:431

also why isn't it indexing the data even tho I force index through the plugin settings

[MordechaiHadad]

also i forgot to say, i just tried using search, the error i got:

           ERROR    Exception in ASGI application                                                        h11_impl.py:369

                    ╭─────────────────────── Traceback (most recent call last) ────────────────────────╮
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\uvicorn │
                    │ \protocols\http\h11_impl.py:366 in run_asgi                                      │
                    │                                                                                  │
                    │   363 │   # ASGI exception wrapper                                               │
                    │   364 │   async def run_asgi(self, app):                                         │
                    │   365 │   │   try:                                                               │
                    │ ❱ 366 │   │   │   result = await app(self.scope, self.receive, self.send)        │
                    │   367 │   │   except BaseException as exc:                                       │
                    │   368 │   │   │   msg = "Exception in ASGI application\n"                        │
                    │   369 │   │   │   self.logger.error(msg, exc_info=exc)                           │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\uvicorn │
                    │ \middleware\proxy_headers.py:75 in __call__                                      │
                    │                                                                                  │
                    │   72 │   │   │   │   │   port = 0                                                │
                    │   73 │   │   │   │   │   scope["client"] = (host, port)  # type: ignore[index]   │
                    │   74 │   │                                                                       │
                    │ ❱ 75 │   │   return await self.app(scope, receive, send)                         │
                    │   76                                                                             │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\fastapi │
                    │ \applications.py:269 in __call__                                                 │
                    │                                                                                  │
                    │   266 │   async def __call__(self, scope: Scope, receive: Receive, send: Send) - │
                    │   267 │   │   if self.root_path:                                                 │
                    │   268 │   │   │   scope["root_path"] = self.root_path                            │
                    │ ❱ 269 │   │   await super().__call__(scope, receive, send)                       │
                    │   270 │                                                                          │
                    │   271 │   def add_api_route(                                                     │
                    │   272 │   │   self,                                                              │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\applications.py:124 in __call__                                               │
                    │                                                                                  │
                    │   121 │                                                                          │
                    │   122 │   async def __call__(self, scope: Scope, receive: Receive, send: Send) - │
                    │   123 │   │   scope["app"] = self                                                │
                    │ ❱ 124 │   │   await self.middleware_stack(scope, receive, send)                  │
                    │   125 │                                                                          │
                    │   126 │   # The following usages are now discouraged in favour of configuration  │
                    │   127 │   # during Starlette.__init__(...)                                       │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\middleware\errors.py:184 in __call__                                          │
                    │                                                                                  │
                    │   181 │   │   │   # We always continue to raise the exception.                   │
                    │   182 │   │   │   # This allows servers to log the error, or allows test clients │
                    │   183 │   │   │   # to optionally raise the error within the test case.          │
                    │ ❱ 184 │   │   │   raise exc                                                      │
                    │   185 │                                                                          │
                    │   186 │   def format_line(                                                       │
                    │   187 │   │   self, index: int, line: str, frame_lineno: int, frame_index: int   │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\middleware\errors.py:162 in __call__                                          │
                    │                                                                                  │
                    │   159 │   │   │   await send(message)                                            │
                    │   160 │   │                                                                      │
                    │   161 │   │   try:                                                               │
                    │ ❱ 162 │   │   │   await self.app(scope, receive, _send)                          │
                    │   163 │   │   except Exception as exc:                                           │
                    │   164 │   │   │   request = Request(scope)                                       │
                    │   165 │   │   │   if self.debug:                                                 │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\exceptions.py:93 in __call__                                                  │
                    │                                                                                  │
                    │    90 │   │   │   │   handler = self._lookup_exception_handler(exc)              │
                    │    91 │   │   │                                                                  │
                    │    92 │   │   │   if handler is None:                                            │
                    │ ❱  93 │   │   │   │   raise exc                                                  │
                    │    94 │   │   │                                                                  │
                    │    95 │   │   │   if response_started:                                           │
                    │    96 │   │   │   │   msg = "Caught handled exception, but response already star │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\exceptions.py:82 in __call__                                                  │
                    │                                                                                  │
                    │    79 │   │   │   await send(message)                                            │
                    │    80 │   │                                                                      │
                    │    81 │   │   try:                                                               │
                    │ ❱  82 │   │   │   await self.app(scope, receive, sender)                         │
                    │    83 │   │   except Exception as exc:                                           │
                    │    84 │   │   │   handler = None                                                 │
                    │    85                                                                            │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\fastapi │
                    │ \middleware\asyncexitstack.py:21 in __call__                                     │
                    │                                                                                  │
                    │   18 │   │   │   │   │   await self.app(scope, receive, send)                    │
                    │   19 │   │   │   │   except Exception as e:                                      │
                    │   20 │   │   │   │   │   dependency_exception = e                                │
                    │ ❱ 21 │   │   │   │   │   raise e                                                 │
                    │   22 │   │   │   if dependency_exception:                                        │
                    │   23 │   │   │   │   # This exception was possibly handled by the dependency but │
                    │   24 │   │   │   │   # still bubble up so that the ServerErrorMiddleware can ret │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\fastapi │
                    │ \middleware\asyncexitstack.py:18 in __call__                                     │
                    │                                                                                  │
                    │   15 │   │   │   async with AsyncExitStack() as stack:                           │
                    │   16 │   │   │   │   scope[self.context_name] = stack                            │
                    │   17 │   │   │   │   try:                                                        │
                    │ ❱ 18 │   │   │   │   │   await self.app(scope, receive, send)                    │
                    │   19 │   │   │   │   except Exception as e:                                      │
                    │   20 │   │   │   │   │   dependency_exception = e                                │
                    │   21 │   │   │   │   │   raise e                                                 │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\routing.py:670 in __call__                                                    │
                    │                                                                                  │
                    │   667 │   │   │   match, child_scope = route.matches(scope)                      │
                    │   668 │   │   │   if match == Match.FULL:                                        │
                    │   669 │   │   │   │   scope.update(child_scope)                                  │
                    │ ❱ 670 │   │   │   │   await route.handle(scope, receive, send)                   │
                    │   671 │   │   │   │   return                                                     │
                    │   672 │   │   │   elif match == Match.PARTIAL and partial is None:               │
                    │   673 │   │   │   │   partial = route                                            │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\routing.py:266 in handle                                                      │
                    │                                                                                  │
                    │   263 │   │   │   │   )                                                          │
                    │   264 │   │   │   await response(scope, receive, send)                           │
                    │   265 │   │   else:                                                              │
                    │ ❱ 266 │   │   │   await self.app(scope, receive, send)                           │
                    │   267 │                                                                          │
                    │   268 │   def __eq__(self, other: typing.Any) -> bool:                           │
                    │   269 │   │   return (                                                           │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\starlet │
                    │ te\routing.py:65 in app                                                          │
                    │                                                                                  │
                    │    62 │   async def app(scope: Scope, receive: Receive, send: Send) -> None:     │
                    │    63 │   │   request = Request(scope, receive=receive, send=send)               │
                    │    64 │   │   if is_coroutine:                                                   │
                    │ ❱  65 │   │   │   response = await func(request)                                 │
                    │    66 │   │   else:                                                              │
                    │    67 │   │   │   response = await run_in_threadpool(func, request)              │
                    │    68 │   │   await response(scope, receive, send)                               │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\fastapi │
                    │ \routing.py:227 in app                                                           │
                    │                                                                                  │
                    │    224 │   │   if errors:                                                        │
                    │    225 │   │   │   raise RequestValidationError(errors, body=body)               │
                    │    226 │   │   else:                                                             │
                    │ ❱  227 │   │   │   raw_response = await run_endpoint_function(                   │
                    │    228 │   │   │   │   dependant=dependant, values=values, is_coroutine=is_corou │
                    │    229 │   │   │   )                                                             │
                    │    230                                                                           │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\fastapi │
                    │ \routing.py:160 in run_endpoint_function                                         │
                    │                                                                                  │
                    │    157 │   assert dependant.call is not None, "dependant.call must be a function │
                    │    158 │                                                                         │
                    │    159 │   if is_coroutine:                                                      │
                    │ ❱  160 │   │   return await dependant.call(**values)                             │
                    │    161 │   else:                                                                 │
                    │    162 │   │   return await run_in_threadpool(dependant.call, **values)          │
                    │    163                                                                           │
                    │                                                                                  │
                    │ C:\Users\morde\AppData\Local\Programs\Python\Python310\lib\site-packages\khoj\ro │
                    │ uters\api.py:419 in search                                                       │
                    │                                                                                  │
                    │   416 │   │                                                                      │
                    │   417 │   │   if (                                                               │
                    │   418 │   │   │   (t == SearchType.Markdown or t == SearchType.All)              │
                    │ ❱ 419 │   │   │   and state.content_index.markdown                               │
                    │   420 │   │   │   and state.search_models.text_search                            │
                    │   421 │   │   ):                                                                 │
                    │   422 │   │   │   # query markdown notes                                         │
                    ╰──────────────────────────────────────────────────────────────────────────────────╯
                    AttributeError: 'NoneType' object has no attribute 'markdown'
           INFO     127.0.0.1:53219 - "GET /api/search?q=MM&n=6&r=false&client=obsidian&t=markdown       h11_impl.py:431
                    HTTP/1.1" 500
                    ```

[MordechaiHadad]

@sabaimran whats your conclusion regarding this?

[debanjum]

Sorry for the delayed follow-up on this. Not sure why your content was not getting indexed. Can you try again with the latest Khoj? Want to make sure this issue has not gotten stale

[TomLucidor]

Keeping tabs on this for LogSeq and other KPM as well, how does indexing work normally with links?

[debanjum]

Hey @TomLucidor, are you unable to index your data with Khoj from Obsidian (or other KPMs) too?