> Breast Density Website Update

Participants,

Hopefully you received this via email but in case you didn't, here it is. Your email will have your credentials.

Thanks again for taking part in the Breast Density FL challenge. We are nearing the end of the challenge and we wanted to remind you of a couple changes and dates to keep in mind.

Up until now you have been emailing breastdensityfl2022@gmail.com your docker archives. We will now be opening direct access to the challenge site (http://breastdensityfl.acr.org/) that runs your algorithms. To use this site, you must have shared your ip-address. Please email breastdensityfl2022@gmail.com with your IP address if you have not already done so. We will now move over to a workflow where you submit your images to this site rather than emailing breastdensityfl2022@gmail.com.

Summary of Redirects:
* http://breastdensityfl.acr.org/ -> https://medici-codalab-main.eastus.cloudapp.azure.com/competitions/24 (up until now)
* http://breastdensityfl.acr.org/ -> https://52.186.168.13 (as of this email's date)

Both sites will remain active but to reach https://medici-codalab-main.eastus.cloudapp.azure.com/competitions/24 you will have to navigate directly to it rather than using the http://breastdensityfl.acr.org/ redirect that used to be in place. If you have trouble accessing http://breastdensityfl.acr.org - First make sure you have sent us your public IP address. If you are still having an issue, clear your cache, and try again in a few hours. You can also use https://52.186.168.13, select “Advanced” -> “proceed.”

Dates to Keep in mind:
* August 7th, 2022: Submission site opens; only submission on the site (http://breastdensityfl.acr.org/) will be accepted. IMPORTANT: We will be extending the training phase by 2 weeks to accommodate this shift.
* August 31st, 2022: Deadline for final submission using the submission site (23:59 AOE):
- You get one submission for the test phase. This will be run by us. In order for you to choose which algorithm is run in this phase, you must run it in the training phase as your last submission. Only your last submission from the training phase will be run in the test phase.
* September 18th, 2022: Winners announced at MICCAI(https://conferences.miccai.org/2022/en/MICCAI2022-CHALLENGES.html) [3:40 PM to 7:10 PM (SGT time)]

Quick Summary of the New Site:
1. Up until now, you emailed your archives, but now you will navigate to the "Participate" tab inside the competition (https://breastdensityfl.acr.org/competitions/1) and select "Submit / View Results" from the left mini navigation pane.
* See attached: "image_1_participate_tab.png"

2. Upload Docker Archive with the "Choose File" button.
* See attached: "image_2_upload_and_run_docker_archive.png"

3. Choose your archive from your local computer and hit select. We will get an email that your archive was uploaded.

4. We will email you when your docker image from your archive is ready to be run.

5. Click the button "Choose Docker Image For Submission" to show a drop down of all your available docker images.

6. When you click submit on the pop-up drop down, your submission will begin. Some algorithms have taken 4 hours and others close to 8. As there is likely a queue of submissions, you may need to wait a couple days to see the results.

7. Your results are in a couple places and in different forms:
a. On the same "Participate" tab you are on is an expandable "+" sign which gives you some extra options for each submission. Option "View Detailed Results will give you a tensorboard overview of your algorithm being trained on all 3 sites."
* See attached: "image_3_view_detailed_results.png"
b. The leader board on each site as described below.
i. https://medici-codalab-main.eastus.cloudapp.azure.com/competitions/24#results will have details about runs and leader board rankings this will be used as the master leaderboard.
ii. https://breastdensityfl.acr.org/competitions/1#results will have a similar leaderboard but only best runs will be shown.

PS: If you have questions please use the forum at http://breastdensityfl.acr.org/ or email breastdensityfl2022@gmail.com. Thanks again for participating!

Posted by: challenge-organizer @ Aug. 8, 2022, 9:29 p.m.

Hi all,

Challenge organizer here. We made a small error in the email that is causing lots of confusion. The url for the new site is:

https://breastdensityfl.acr.org

not

http://breastdensityfl.acr.org

The https is important.

Posted by: challenge-organizer @ Aug. 9, 2022, 4:15 p.m.
Post in this thread