Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Good First Issue][Keras 3 OpenVINO Backend]: Support numpy.argsort operation #29012

Open
rkazants opened this issue Feb 15, 2025 · 3 comments
Open
Assignees
Labels
good first issue Good for newcomers Keras 3 OpenVINO Backend Keras 3 OpenVINO Backend no_stale Do not mark as stale

Comments

@rkazants
Copy link
Member

Context

🚀**A great opportunity to contribute to two popular AI projects with just one PR:: Keras 3 and OpenVINO.**🚀

Keras 3 enables seamless switching between supported backends—PyTorch, TensorFlow, and JAX—for both training and inference of traditional models and LLMs/GenAI pipelines. Since Keras 3.8.0, we've introduced a preview version of the OpenVINO backend (for inference only), allowing developers to leverage OpenVINO for model predictions directly within Keras 3 workflows. Activating the OpenVINO backend requires just one line of code to run inference on Keras 3-trained models. Here’s an example for a BERT model from Keras Hub:

import os
os.environ["KERAS_BACKEND"] = "openvino"
import numpy as np
import keras
import keras_hub

features = {
    "token_ids": np.ones(shape=(2, 12), dtype="int32"),
    "segment_ids": np.array([[0, 0, 0, 0, 0, 1, 1, 1, 1, 1, 0, 0]] * 2),
    "padding_mask": np.array([[1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 0, 0]] * 2),
}

classifier = keras_hub.models.BertTextClassifier.from_preset("bert_base_en_uncased", num_classes=4, preprocessor=None)
output = classifier.predict(features)

Currently, the OpenVINO backend lacks support for some operations. Our goal is to resolve this gap and to optimize it for inference on Intel devices—including CPUs, integrated GPUs, discrete GPUs, and NPUs—by supporting as many models as possible while delivering optimal performance. We aim to make the OpenVINO backend the No. 1 choice for model inference within the Keras 3 workflow.

What needs to be done?

Steps to Contribute

  1. Set up your developer environment:
  • fork and clone keras repo
  • install requirements for OpenVINO backend development pip install -r requirements-openvino.txt. The requirements file can be found in the root directory of cloned repository
  1. Provide decomposition in Python for numpy.argsort using OpenVINO opset

  2. Include tests by removing line corresponding to the implemented operation in excluded_concrete_tests.txt file.

  3. Make sure that tests are passing

  • create pytest.ini file and place it in the root directory of the clone repository. This file should contain the following content:
[pytest]
env =
    KERAS_BACKEND=openvino
  • run tests pytest-c ./pytest.ini ./keras/src/ops/numpy_test.py
  1. Commit your changes and create PR in keras repository. Mention @rkazants in PR description for review.

Below is an exemplar PR of how support for numpy.amax has been implemented.

Example Pull Requests

Resources

Contact points

@rkazants

Ticket

No response

@nikolasavic3
Copy link

.take
I would like to solve this :)

Copy link
Contributor

Thank you for looking into this issue! Please let us know if you have any questions or require any help.

@mlukasze mlukasze moved this from Contributors Needed to Assigned in Good first issues Feb 17, 2025
@geeky33
Copy link
Contributor

geeky33 commented Feb 22, 2025

@rkazants
Greetings,
sir is there any possibility to get a new issue assigned related to this topic?

I would like to try this as a new opportunity and learn from it!

Thank you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers Keras 3 OpenVINO Backend Keras 3 OpenVINO Backend no_stale Do not mark as stale
Projects
Status: Assigned
Development

No branches or pull requests

3 participants