Add Computer Vision (CV) functions #27
Conversation
tzolov
changed the title
...vision-function/src/main/java/org/springframework/cloud/fn/computer/vision/package-info.java
Outdated
Show resolved
Hide resolved
...ework/cloud/fn/computer/vision/translator/TensorflowSavedModelObjectDetectionTranslator.java
Show resolved
Hide resolved
...tion/src/main/java/org/springframework/cloud/fn/computer/vision/translator/package-info.java
Outdated
Show resolved
Hide resolved
...a/org/springframework/cloud/fn/computer/vision/ComputerVisionFunctionConfigurationTests.java
Outdated
Show resolved
Hide resolved
...a/org/springframework/cloud/fn/computer/vision/ComputerVisionFunctionConfigurationTests.java
Outdated
Show resolved
Hide resolved
| * @author Christian Tzolov | ||
| */ | ||
| @AutoConfiguration(after = DjlAutoConfiguration.class) | ||
| @EnableConfigurationProperties({ DjlConfigurationProperties.class, ComputerVisionFunctionProperties.class }) |
| * `Function<Message<byte[]>, Message<byte[]>> imageClassifications` - The `Image Classification` task assigns a label to an image from a set of categories. | ||
| * `Function<Message<byte[]>, Message<byte[]>> semanticSegmentation` - `Semantic Segmentation` refers to the task of detecting objects of various classes at pixel level. | ||
| It colors the pixels based on the objects detected in that space. | ||
| * `Function<Message<byte[]>, Message<byte[]>> poseEstimation` - `Pose Estimation` refers to the task of detecting human figures in images and videos, and estimating the pose of the bodies. |
There was a problem hiding this comment.
I'm not sure where my comment is lost, but I'll repeat it.
It is better for end-user just to auto-wire a single function and leave the rest of hard logic up to internal routing.
You still can have those Function instances internally, but better to just expose only a single function for auto-configuration and so.
I would go with Spring Integration router, but probably a simple switch by some configuration property would be enough.
The point is that we pursue here a microservices architecture therefore a single auto-configured service from this module is what everyone would expect in their projects.
Any arguments that we have to leave it as a number of functions ?
Or... We might go with all those beans for functions since I see they are conditional, but let's see if we can make them with the same bean name in the end! So, target project would benefit from the same @Autowire without any paradox of choice for name.
|
Hey, @tzolov ! We have a release this Thursday: let us know if you going to clean up the latest review round! Thanks |
|
Moved to the next milestone since we have to release today, but this has not been finished yet. |
|
Merged as 55f09da. I had to As I said before: I named all the conditional functions in the configuration as a Thank you! |
|
Looks like the build on Linux was good: https://ge.spring.io/s/wbqpfk6vghzbs/tests/task/:spring-computer-vision-function:test/overview |
This module is a replacement of the outdated TendorFlow functions.
It provides functions for performing common CV tasks such as Image Classification, Object Detection, Instance and Semantic Segmentation, Pose Estimation an more.
The implementation leverages the Deep Java Library (DJL) that serves as a bridge between the Java ecosystem and the cutting-edge capabilities of deep learning.
DJL provides integration with popular deep learning frameworks like TensorFlow, PyTorch, and MXNet, as well as support for a variety of pre-trained models using ONNX Runtime.
Consult project's README for detailed information.
See #20