Skip to content
This repository was archived by the owner on Oct 31, 2023. It is now read-only.

change dim=-1 to dim=1 in bounding_box.py for the purpose of tracing using jit#1022

Open
zimenglan-sysu-512 wants to merge 47 commits intofacebookresearch:mainfrom
zimenglan-sysu-512:master
Open

change dim=-1 to dim=1 in bounding_box.py for the purpose of tracing using jit#1022
zimenglan-sysu-512 wants to merge 47 commits intofacebookresearch:mainfrom
zimenglan-sysu-512:master

Conversation

@zimenglan-sysu-512
Copy link
Contributor

@zimenglan-sysu-512 zimenglan-sysu-512 commented Aug 6, 2019

when trace the rpn and rcnn heads using torch.jit.trace, it encouters the problem vector::_M_range_check: __n (which is 18446744073709551615) >= this->size() (which is 2), and find that it is caused by the dim=-1 in bounding_box.py file. so changing all of dim=-1 to dim=1 can solve it.

…d use 'BaseStem'&'Bottleneck' to simply codes
@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 6, 2019
@botcs
Copy link
Contributor

botcs commented Sep 16, 2019

Hi @zimenglan-sysu-512 ,
Thanks for spotting this!

Can you please provide a short script to reproduce this error?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

awaiting response bug Something isn't working CLA Signed Do not delete this pull request or issue due to inactivity.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants