Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New AI search takes more storage space than earlier Azure cognitive search version #302

Open
mvishwakarma93 opened this issue Feb 13, 2025 · 0 comments

Comments

@mvishwakarma93
Copy link

We use Azure cognitive search in one of our applications as a read model, I december 2024 we thought of upgrading ourselves from traditional Azure cognitive search to now named a Azure AI search and created a new basic tier service.

Right now in Old azure coginitve search we have approx 5M of documents which takes around 6GB of total storage as shown in image below. Below are the specifications of the same:

  1. Created in 2021 tentative
  2. Tier : Standard
  3. Replicas : 3
  4. Partitions: 1
  5. Total Documents: ~5M
  6. Storage occupied: 6GB

Image

Upon moving to new AI search we rebuilt the indexes with the same ARM template and function that is responsible for creating documents for old one as shown in image below. Below are the observations after creation

  1. Created in December end 2024
  2. Tier: Basic
  3. Replicas: 3
  4. Partitions: 1
  5. Total Documents: ~5M(Same documents as in old version with some additional documents as its in use now)
  6. Storage: ~11GB

Image

Question:

  1. Why is there so much of a difference between these two in terms of storage?
  2. What`s new in AI search that needs more space?
  3. What can be done to reduce the space issue?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant