This document is a living summary of conventions and best practices for development within Zowe API Mediation Layer.
- Contact Us
- Understanding Modules
- Pull Requests
- General Guidelines
- Code Guidelines
- File Naming Guidelines
- Branch Naming Guidelines
- Commit Message Structure Guideline
- Testing Guidelines
- Build Process Guidelines
- Documentation Guidelines
- Planning Guidelines
- Retrospective Guidelines
Get in touch using Zowe Communication Channels. You can find us in the #zowe-api
channel on Slack.
Modules are individual folders inside ‘api-layer` root folder. Refer to the below table for the purpose of the more important modules.
Package Folder | Purpose |
---|---|
api-catalog-services | Core Service - API Catalog |
api-catalog-ui | Core Service - API Catalog UI |
apiml-common | Library - Common code with Spring |
apiml-security-common | Library - Common security code |
apiml-utility | Library - Utilities |
codequality | Config - Checkstyle |
common-service-core | Library - Common code Java |
config | Config - Local config |
discoverable-client | Test Service - Discoverable Client |
discovery-service | Core Service - Discovery Service |
docker | Tool - Dev Docker Container |
docs | Documentation |
gateway-service | Core Service - Gateway Service |
gradle | Config - Project-wide Gradle tasks |
integration-tests | Test - Integration test |
keystore | Config - Local TLS config |
metrics-service | Core Service - Metrics Service |
metrics-service-ui | Core - Service - Metrics Service UI |
mock-services | Test - Mock z/OS services |
onboarding-enabler-java | APIML SDK - Java Enabler |
onboarding-enabler-java-sample-app | Sample Service - Java Enabler |
onboarding-enabler-micronaut | APIML SDK - Micronaut Enabler |
onboarding-enabler-micronaut-sample-app | Sample Service - Micronaut Enabler |
onboarding-enabler-nodejs | APIML SDK - Node.js Enabler |
onboarding-enabler-nodejs-sample-app | Sample Service - Node.js Enabler |
onboarding-enabler-spring | APIML SDK - Spring Enabler |
onboarding-enabler-spring-sample-app | Sample Service - Spring Enabler |
passticket | Test - Passticket test tools |
scripts | Tool - Test and Build scripts |
security-service-client-spring | Library - Security Client |
zaas-client | APIML SDK - ZAAS Client |
zlux-api-catalog | Library - Zlux Api Catalog plugin |
The following list describes general conventions for contributing to api-layer:
- Communicate frequently (before pull request) with team member representatives for new design features.
- Before implementing new functionality, reach out to squad members and discuss architecture and design.
- Get in contact using Slack’s
#zowe-api
channel, attend squad meetings or create anEnhancement
issue on GitHub. - Reuse logging and error handling patterns already in place.
- Document your code with appropriate Javadoc and inline comments. In JavaScript parts of the code please use JSDoc style comments.
- Create end-user documentation on docs-site if needed.
- Provide adequate logging to diagnose problems that happen at external customer sites.
- Use sensible class, method, and variable names.
- Keep core services independent without cross dependencies.
- Keep classes small, maintain Single Responsibility Principle.
- Pull requests should include tests.
- Code coverage for new code should be at least 80%.
- Code coverage should not be lower than on master.
- SonarCloud quality gate should be passed and no code smells, security hotspots and bugs should be added in pull requests.
- If the pull request adds or changes functionality that requires an update of packaging or configuration, it needs to be tested on a test system installed from the Zowe PAX file.
- Keep pull requests as small as possible. If functionality can be split into multiple pull requests which will not break the master after being merged separately, this will speed up the review process and give a better level of safety rather than merging a single pull request containing many lines of code.
There are two ways to name new branches to simplify orientation. One is used for work on Github issues and one is used for small contributions that don't deserve an issue.
GitHub Issues: <team-tag>/<work-tag>/<name-tag>
an example would be: rip/GH752/per_service_timeout_options
Small personal contributions: private/<person-tag>/<name-tag>
an example would be: private/jb892003/temporarily_disable_e2e_tests
- team-tag
The team contributing on the Broadcom side for example is names Rest In aPi and so the rip
is used. If there isn't a team involved, use your personal Github handle e.g. balhar-jakub
or jandadav
- work-tag
Represents a codified and searchable reference to problem that the branch solves. For Github issues, you would use GH
prefix and Github issue number
.
- person-tag
Represents a unique identifier for specific person. The good candidate is the Github handle such as balhar-jakub
or jandadav
.
- name-tag
Please keep the name short and relevant.
The following list describes the conventions for naming the source files:
- Follow Java file, class and package naming conventions.
- Master package should be
org.zowe.apiml
. - Subpackage names are single lowercase words, named by feature. For example
security
,message
,config
. - Keep the hierarchy shallow.
Indent code with 4 spaces. This is also documented via .editorconfig
, which can be used to automatically format the code if you use an EditorConfig extension for your editor of choice.
Lint rules are enforced through our build process.
- Core team uses TDD practices.
- All code in PRs should be covered with unit tests.
- Add integration tests where needed. The integration tests are executed with Github Actions using the workflows defined in .github/workflows. Contact the API Layer squad if you need triage. The Mock zOSMF service is used for verifying integration with zOSMF.
- Add UI end to end tests where needed. The end to end tests are executed with Github Actions using the workflows defined in .github/workflows. Contact API Layer squad if you need triage.
- Use meaningful test method names. We use the
given_when_then
pattern. - Leverage
@Nested
annotation for test method grouping where possible. It makes the tests more organized and readable. The test method names are generally shorter. - When adding tests to method not following
given_when_then
or not leveraging the@Nested
annotation refactor the class before adding further tests. - Example of well written test: CachingControllerTest.java. It uses
@Nested
annotation to separate the test scenarios into groups, which are individually setup. The tests are short and clear and the method names clearly convey what is tested. - Some of our java unit tests are still written in JUnit4, since we didn’t fully migrate them to JUnit5 and we have a backward compatibility package. However, use JUnit5 for new tests.
We use gradle build
task to build a solution. The build executes the following:
- Checkstyle lint
- License check
- Unit tests
You can run Integration Tests locally before creating a pull request.
Commits going to a master branch should stick to the Conventional Commits specification. This is a lightweight convention on the top of the commit messages. Template:
<type>[optional scope]: <description>
[optional body]
[footer(s)]
Basic example:
feat(authentication): Introducing x509 as a form of authentication
This is a body, which is purely optional. One can use this section if description is not enough to provide insight.
Can also contains notes and hints. Should not be too long.
Signed-off-by: John Doe <[email protected]>
- fix: patches a bug in your codebase (this correlates with PATCH in semantic versioning)
- feat: introduces a new feature to the codebase (this correlates with MINOR in semantic versioning)
- docs: affecting the documentation
- refactor: refactoring the code
- chore: cleaning in general, update dependencies
Type or scope appended with !
has the same meaning as BREAKING CHANGE(explained in footer section). It introduces a breaking API change (correlating with MAJOR in semantic versioning). MUST be used with caution!
Optional part of the message. Identifies a part of the codebase altered byt this commit. Examples could be: authentication, Discovery service, ...
A description MUST immediately follow the colon and space after the type/scope prefix. The description is a short summary of the code changes, e.g., fix: array parsing issue when multiple spaces were contained in string
.
A commit body is free-form and MAY consist of any number of newline separated paragraphs.
- Signed-off-by: every commit needs to be signed by at least one author
- Reviewed-by: (OPTIONAL) is a plus, but not necessary
- Co-authored-by: (OPTIONAL) in case of more contributors engaged
- BREAKING CHANGE: (OPTIONAL) introduces a breaking API change (correlating with MAJOR in semantic versioning). A BREAKING CHANGE can be part of commits of any type. MUST be used with caution!
Consider the following when you create or respond to pull requests:
- Every pull request must have associated issue in api-layer repository and link to it
- Pull request reviewers should be assigned to a squad team member.
- Use a draft pull request for work in progress that you want to build on the CICD pipeline.
- Anyone can comment on a pull request to request a delay on merging or to get questions answered.
- If you split functionality into several pull requests, consider using a common naming prefix for logical grouping (Github issue number for example).
- Review guidelines for how to write the perfect pull request and good commits.
To provide long-term support(LTS) for versions in maintenance mode, any security fix must be merged to the master branch as a separate commit. The reasoning behind these requirements is, that security fixes will be cherry-picked to the maintenance versions of API Mediation layer.
Open a pull request in the docs-site repository to create documentation for your contribution.
- Create end-user documentation for how to use your feature, functionality. This end-user documentation can be drafted collaboratively with a tech writer.
- Open an issue in docs-site repository if you need assistance.
- End-user documentation requires review and approval by a tech writer. Address all comments raised by the tech writer during review.
- Include a readme.md file within the repository that contains information for developers that, at a minimum, includes an overview, how to build, and how to run tests, if applicable. For example, see the passticket test programs.
In addition to external documentation, please thoroughly comment your code for future developers who want to understand, use, and enhance your feature.
Methods and classes should have concise javadoc describing usage and purpose.
The new issues raised in the GitHub are triaged and sized weekly in the Wednesday Squad meetings. There is an Open Mainframe Project Zowe calendar with the squad meetings.
In order to get a better understanding for the complexity of different issues and to improve the quality and reliability of our planning we size issues that the squad takes responsibility for. The sizing is relative considering the complexity of a particular issue compared to the others.
For sizing we use the Fibonacci sequence: 1,2,3,5,8,13 The higher the number the more complex the work involved or more uncertainty around how to implement the solution.
- 0.5 The smallest meaningful issue that delivers value on its own. An example: Explore CodeQL for for Github Actions
- 1 Usually no collaboration within the squad is necessary and the fix can be delivered mainly by one team member. An example: Streamline Single Sign On Documentation
- 2 Ideal size of a story. It allows meaningful collaboration (i.e. to split the issue into separate tasks among multiple members). The issue is delivered within a Sprint. An example: Add logout functionality to the ZAAS client
- 3 Good size of a story. It is possible to collaborate among multiple members. The fix to the issue is usually delivered within a Sprint. An example: Alpha of client certificate using SAF API
- 5 Problems start at this size. If possible split the issue into multiple smaller ones and focus namely on the value delivered (i.e. do the smaller issues still bring value if delivered separately?). Unless it is possible to collaborate on the issue among more members of the squad, it is possible that the issue won't fit into one sprint. An example: Support the x509 client certificate authentication via x509
- 8 Large issue. Unless there is a good way to split the issue or collaborate, the risk of not being able to deliver the issue within a sprint is quite large. Split to smaller issues if possible. An example: Implement Caching Service
- 13 WARNING: Here be lions! We haven't used this size so far. If it occurs split the issue into smaller issues.
The squad regularly observes the following metrics and actively explores areas for continuous improvement
- Cummulative flow report for the work in progress
- Control chart report for cycle time
- Opened pull requests
- Binary snapshot release github action for stability
- GitHub Insights
- Linux Foundation Insights on GitHub PR Timing
- sonarcloud quality gate
- Squad's velocity sheet
- Squad's Trello retrospective board
- on a biweekly basis we discuss on the Monday calls what we managed to achieve in the past iteration and learn from that, pay attention to the actual start and end dates of a particular iteration