Skip to content

[2/2] Add Image Ops for Data Augmentation #1353

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
2 of 13 tasks
vinayvr11 opened this issue Mar 20, 2020 · 6 comments
Closed
2 of 13 tasks

[2/2] Add Image Ops for Data Augmentation #1353

vinayvr11 opened this issue Mar 20, 2020 · 6 comments

Comments

@vinayvr11
Copy link

vinayvr11 commented Mar 20, 2020

Part 1: #1333

As part of #1226, relevant image ops need to be added to tfa.image. List of ops tracked in this issue (tick the op only once the corresponding PR is merged):

  • to grayscale
  • color jitter
  • color jitter nonrand
  • color jitter rand
  • compute crop shape
  • center crop
  • distorted bounding box crop
  • crop and resize
  • gaussian blur
  • random crop with resize
  • random color jitter
  • random blur
  • batch random blur

Reference: https://github.com/google-research/simclr/blob/master/data_util.py

@vinayvr11
Copy link
Author

@gabrieldemarmiesse, @dynamicwebpaige does this issue is meaningfull for Tensorlfow.

@Squadrick Squadrick changed the title Add image operations for image processing to TF 2.x [2/2] Add Image Ops for Data Augmentation Mar 25, 2020
@Squadrick
Copy link
Member

@vinayvr11 Closing #1342, create separate PRs for each op.

@vinayvr11
Copy link
Author

Sure @Squadrick i will make seperate PR for all operations.

@ghosalsattam
Copy link
Contributor

ghosalsattam commented May 9, 2020

@gabrieldemarmiesse The list does not contain Canny Edge detection. But it is useful functionality and is contained in almost all Standard image processing libraries. Should it be added?

@bhack
Copy link
Contributor

bhack commented May 9, 2020

@gabrieldemarmiesse The list does not contain Canny Edge detection. But it is useful functionality and is contained in almost all Standard image processing libraries. Should it be added?

About image processing I think that we need to think about priorities:

  • Is the op useful for image (auto)augmentation/preprocessing?
  • Is the op useful for postprocessing the network output?
  • if are not in the first two cases what is the use case of that specific op VS a network that learn that task (e.g. in the edge detector case see https://arxiv.org/abs/2003.08235 just to mention a recent work)? Are we planning to contribute a differentiable version of the ops to learn that task?

In the first two case, as an example, see how many Opencv calculators (search for cv::) mediapipe still need to implement in its demos other then tensorflow inference.

@seanpmorgan
Copy link
Member

Per #1226 (comment) the autoaugment/randaugment features will be a part of https://github.com/keras-team/keras-cv

Apologies for not being able to present this information sooner to the contributors.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants