Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can I use different penalty for different group #17

Open
yzhaobk opened this issue Apr 26, 2017 · 1 comment
Open

How can I use different penalty for different group #17

yzhaobk opened this issue Apr 26, 2017 · 1 comment

Comments

@yzhaobk
Copy link

yzhaobk commented Apr 26, 2017

In my case, the group size in group lasso in algorithm is not unified and for different group it may should use different penalty (like $\sqrt(p_j)$ where $p_j$ is the degree of freedom of each group).

However, it seems that in your algorithm the penalty coefficients for groups is always the same, which may lead to some inconsistency.

@tomlof
Copy link
Collaborator

tomlof commented May 8, 2017

Assuming you use for instance estimators.LinearRegressionL1L2GL, then you must provide a linear operator for the Nesterov Smoothing. If you generate this operator using functions.nesterov.linear_operator_from_groups, then you can pass a list weights, that contains weights for each individual group. You can see in the doctests for estimators.LinearRegressionL1L2GL how to use it, or in the tests in tests.test_group_lasso.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants