Dear all,
As part of the work to complete the Error Reporter Epic for our next prioritisation meeting error reports over a 4 week period from mid-September to mid-October were looked at. Of all the reports submitted only 3% were actionable - i.e. only 3% had contact information to be able to request further information to try and resolve them and/or provided sufficient information to enable us to reproduce the error.
Clearly this highlights how important it is to overhaul the error reporting system. However, even if the epic comes up at the next prioritisation meeting in February (as we currently plan) we are unlikely to be able to start work until the summer. Even then we might not get a solution in place before the end of 2024.
As a result I wonder if it would be possible for you to highlight this issue with your networks? The hope being we can improve on this figure a little before the new Error Reporter is in place. If we are only able to respond to around 3% of error reports then it is no wonder we have gained a reputation for not doing anything. We have a much higher response rate for e-mails through to mantid-help(a)mantidproject.org<mailto:mantid-help@mantidproject.org> so I would recommend people use this rather than relying on the error reporter.
I have also highlighted this research to our partners on the Mantid Technical Working Group so that they can highlight the issue with their networks at the other facilities.
Many thanks
Sarah
Sarah Foxley
Mantid Team Leader and Mantid Project Manager
Science and Technology Facilities Council
Phone - 01235 446938
sarah.foxley(a)stfc.ukri.org<mailto:sarah.foxley@stfc.ukri.org>
She/Her/Hers
[stfc_logo]
Dear Tom,
Here is an example of data, python script generated from mantid fitting (sent as txt as our mailing system does not like sending .py file) and a plot that shows how bad the fit is, although mantid believe this is a perfectly acceptable fit.
If you get the starting parameters near spot on, it will eventually refine.
This is trying to fit a back to back expo, typical of time of flight data on a diffractometer (but I have seen similar things with simple gaussian!)
Other programs (also using LM methods) do a good job. in particular, the python fitting routines seem to do the job.
Hope this helps,
P
Dr Pascal Manuel
ISIS Pulsed Neutron and Muon Facility
STFC Rutherford Appleton Laboratory
Chilton
Oxfordshire OX11 0QX
United Kingdom
Office: + 44 (0)1235 446290
Beamline : +44 (0)1235 567080
Mobile: +44(0) 7833 965011 (also for WhatsApp)
ZoomID : https://ukri.zoom.us/j/5735149151
Skype : pascal.manuel73
________________________________
From: Hampson, Thomas (STFC,RAL,ISIS) <thomas.hampson(a)stfc.ac.uk>
Sent: Wednesday, November 22, 2023 5:32 PM
To: ISIS Instrument Scientist <ISISInstsci(a)stfc.ac.uk>
Cc: Foxley, Sarah (STFC,RAL,ISIS) <sarah.foxley(a)stfc.ac.uk>; Farooq, Rabiya (STFC,RAL,ISIS) <Rabiya.Farooq(a)stfc.ac.uk>; Haigh, Jonathan (STFC,RAL,ISIS) <Jonathan.Haigh(a)stfc.ac.uk>
Subject: RE: Mantid fitting engine replacement
Hi All,
Many thanks to those of you who have replied so far with examples that demonstrate the limitations of our current fitting framework. I will respond to you individually shortly to make sure I have enough information to add them to the fitbenchmarking dataset.
If anyone else has any examples of problems they’ve had with fitting in Mantid then I would be grateful for your response. More data will help us make a better informed decision about the potential replacement of the fitting engine.
Regards,
Tom Hampson
From: Hampson, Thomas (STFC,RAL,ISIS)
Sent: 08 November 2023 12:38
To: ISIS Instrument Scientist <ISISInstsci(a)stfc.ac.uk>
Cc: Foxley, Sarah (STFC,RAL,ISIS) <sarah.foxley(a)stfc.ac.uk>; Farooq, Rabiya (STFC,RAL,ISIS) <Rabiya.Farooq(a)stfc.ac.uk>; Haigh, Jonathan (STFC,RAL,ISIS) <jonathan.haigh(a)stfc.ac.uk>
Subject: Mantid fitting engine replacement
Dear ISIS Instrument Scientists,
We are in the process of evaluating potential replacements for the Mantid fitting engine and need your input. We are seeking real examples that will help us quantify the limitations of the current engine.
Specifically, we would appreciate your feedback on any issues you've encountered with the Mantid fitting engine, such as:
- Sensitivity to initial parameter values
- Slow performance
- Getting stuck in local minima
To assist us in this evaluation, please provide examples with the following information:
- Fit function used
- Data used in the fit
- Fit range
- Initial parameter values
- Any additional information you believe is relevant
The data you provide will be used with the FitBenchmarking tool, maintained by RSE in ISIS. This will help us determine whether there is a more suitable replacement.
We also welcome any general feedback on the fitting in Mantid and the fitting interface.
The deadline for your input is the end of November.
Your contributions will greatly assist us in making informed decisions about the future of the Mantid fitting engine.
Thank you for your assistance.
Sincerely,
Tom Hampson (on behalf of the Mantid team)
Hi All,
This is the invite for the next MPB meeting, the agenda can be found here<https://stfc365.sharepoint.com/:f:/r/sites/MantidProgrammeBoard/Shared%20Do…>
All the best,
Jonathan
[https://st2.zoom.us/static/6.3.17277/image/new/ZoomLogo_110_25.png] <http://zoom.us>
Hi there,
Jonathan Haigh - STFC UKRI is inviting you to a scheduled Zoom meeting.
Join Zoom Meeting<https://ukri.zoom.us/j/91773689182?from=addon>
Phone one-tap: United Kingdom: +441314601196,,91773689182#<tel:+441314601196,,91773689182#> or +442034815237,,91773689182#<tel:+442034815237,,91773689182#>
Meeting URL: https://ukri.zoom.us/j/91773689182?from=addon
You can test your connection prior to the meeting here: https://ukri.zoom.us/test
Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
United Kingdom: +44 131 460 1196 or +44 203 481 5237 or +44 203 481 5240 or +44 203 901 7895 or +44 208 080 6591 or +44 208 080 6592 or +44 330 088 5830 or 0 800 358 2817 (Toll Free) or 0 800 456 1369 (Toll Free) or 0 800 031 5717 (Toll Free) or 0 800 260 5801 (Toll Free)
Meeting ID: 917 7368 9182
International numbers<https://ukri.zoom.us/u/aeAu8psLC0>
Join from an H.323/SIP room system
H.323: 162.255.37.11 (US West)
162.255.36.11 (US East)
115.114.131.7 (India Mumbai)
115.114.115.7 (India Hyderabad)
213.19.144.110 (Amsterdam Netherlands)
213.244.140.110 (Germany)
103.122.166.55 (Australia Sydney)
103.122.167.55 (Australia Melbourne)
69.174.57.160 (Canada Toronto)
65.39.152.160 (Canada Vancouver)
Meeting ID: 917 7368 9182
SIP: 91773689182(a)zoomcrc.com
Skype for Business (Lync)
https://ukri.zoom.us/skype/91773689182
Skype on a SurfaceHub
SIP: 91773689182(a)lync.zoom.us<https://ukri.zoom.us/skype/91773689182>
From: Hampson, Thomas (STFC,RAL,ISIS) <thomas.hampson(a)stfc.ac.uk>
Sent: 08 November 2023 12:38
To: ISIS Instrument Scientist <ISISInstsci(a)stfc.ac.uk>
Cc: Foxley, Sarah (STFC,RAL,ISIS) <sarah.foxley(a)stfc.ac.uk>; Farooq, Rabiya (STFC,RAL,ISIS) <Rabiya.Farooq(a)stfc.ac.uk>; Haigh, Jonathan (STFC,RAL,ISIS) <Jonathan.Haigh(a)stfc.ac.uk>
Subject: Mantid fitting engine replacement
Dear ISIS Instrument Scientists,
We are in the process of evaluating potential replacements for the Mantid fitting engine and need your input. We are seeking real examples that will help us quantify the limitations of the current engine.
Specifically, we would appreciate your feedback on any issues you've encountered with the Mantid fitting engine, such as:
- Sensitivity to initial parameter values
- Slow performance
- Getting stuck in local minima
To assist us in this evaluation, please provide examples with the following information:
- Fit function used
- Data used in the fit
- Fit range
- Initial parameter values
- Any additional information you believe is relevant
The data you provide will be used with the FitBenchmarking tool, maintained by RSE in ISIS. This will help us determine whether there is a more suitable replacement.
We also welcome any general feedback on the fitting in Mantid and the fitting interface.
The deadline for your input is the end of November.
Your contributions will greatly assist us in making informed decisions about the future of the Mantid fitting engine.
Thank you for your assistance.
Sincerely,
Tom Hampson (on behalf of the Mantid team)
Edit: Updated the Kanban board link
Important: We have booked R3 G34 for this meeting
Hi all,
This is a meeting specifically focusing on the prioritization of Epics on the Mantid Programme Kanban board. Please remember to add any comments to the Epics prior to this meeting.
https://isisneutronmuon.atlassian.net/jira/software/c/projects/SS/boards/5
Kind Regards,
Rob
[https://st2.zoom.us/static/6.3.16810/image/new/ZoomLogo_110_25.png]<http://zoom.us/>
Hi there,
Robert Applin - STFC UKRI is inviting you to a scheduled Zoom meeting.
Join Zoom Meeting<https://ukri.zoom.us/j/93974461439>
Phone one-tap:
US: +15642172000,,93974461439#<tel:+15642172000,,93974461439> or +16469313860,,93974461439#<tel:+16469313860,,93974461439>
Meeting URL:
https://ukri.zoom.us/j/93974461439
You can test your connection prior to the meeting here: https://ukri.zoom.us/test
Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 564 217 2000 or +1 646 931 3860 or +1 669 444 9171 or +1 669 900 6833 or +1 689 278 1000 or +1 719 359 4580 or +1 929 205 6099 or +1 253 205 0468 or +1 253 215 8782 or +1 301 715 8592 or +1 305 224 1968 or +1 309 205 3325 or +1 312 626 6799 or +1 346 248 7799 or +1 360 209 5623 or +1 386 347 5053 or +1 507 473 4847 or 833 928 4608 (Toll Free) or 833 928 4609 (Toll Free) or 833 928 4610 (Toll Free) or 877 853 5257 (Toll Free) or 888 475 4499 (Toll Free) or 833 548 0276 (Toll Free) or 833 548 0282 (Toll Free)
Meeting ID:
939 7446 1439
International numbers<https://ukri.zoom.us/u/abMFvUHKyT>
Join from an H.323/SIP room system
H.323:
162.255.37.11 (US West)
162.255.36.11 (US East)
115.114.131.7 (India Mumbai)
115.114.115.7 (India Hyderabad)
213.19.144.110 (Amsterdam Netherlands)
213.244.140.110 (Germany)
103.122.166.55 (Australia Sydney)
103.122.167.55 (Australia Melbourne)
69.174.57.160 (Canada Toronto)
65.39.152.160 (Canada Vancouver)
Meeting ID:
939 7446 1439
SIP:
93974461439(a)zoomcrc.com<mailto:93974461439@zoomcrc.com>
Skype for Business (Lync)
https://ukri.zoom.us/skype/93974461439
Skype on a SurfaceHub
SIP: 93974461439(a)lync.zoom.us<https://ukri.zoom.us/skype/93974461439>
Important: We have booked R3 G34 for this meeting
Hi all,
This is a meeting specifically focusing on the prioritization of Epics on the Mantid Programme Kanban board. Please remember to add any comments to the Epics prior to this meeting.
https://test-jira-3.atlassian.net/jira/software/c/projects/SS/boards/4?atlO…
Kind Regards,
Rob
[https://st2.zoom.us/static/6.3.16810/image/new/ZoomLogo_110_25.png]<http://zoom.us/>
Hi there,
Robert Applin - STFC UKRI is inviting you to a scheduled Zoom meeting.
Join Zoom Meeting<https://ukri.zoom.us/j/93974461439>
Phone one-tap:
US: +15642172000,,93974461439#<tel:+15642172000,,93974461439> or +16469313860,,93974461439#<tel:+16469313860,,93974461439>
Meeting URL:
https://ukri.zoom.us/j/93974461439
You can test your connection prior to the meeting here: https://ukri.zoom.us/test
Join by Telephone
For higher quality, dial a number based on your current location.
Dial:
US: +1 564 217 2000 or +1 646 931 3860 or +1 669 444 9171 or +1 669 900 6833 or +1 689 278 1000 or +1 719 359 4580 or +1 929 205 6099 or +1 253 205 0468 or +1 253 215 8782 or +1 301 715 8592 or +1 305 224 1968 or +1 309 205 3325 or +1 312 626 6799 or +1 346 248 7799 or +1 360 209 5623 or +1 386 347 5053 or +1 507 473 4847 or 833 928 4608 (Toll Free) or 833 928 4609 (Toll Free) or 833 928 4610 (Toll Free) or 877 853 5257 (Toll Free) or 888 475 4499 (Toll Free) or 833 548 0276 (Toll Free) or 833 548 0282 (Toll Free)
Meeting ID:
939 7446 1439
International numbers<https://ukri.zoom.us/u/abMFvUHKyT>
Join from an H.323/SIP room system
H.323:
162.255.37.11 (US West)
162.255.36.11 (US East)
115.114.131.7 (India Mumbai)
115.114.115.7 (India Hyderabad)
213.19.144.110 (Amsterdam Netherlands)
213.244.140.110 (Germany)
103.122.166.55 (Australia Sydney)
103.122.167.55 (Australia Melbourne)
69.174.57.160 (Canada Toronto)
65.39.152.160 (Canada Vancouver)
Meeting ID:
939 7446 1439
SIP:
93974461439(a)zoomcrc.com
Skype for Business (Lync)
https://ukri.zoom.us/skype/93974461439
Skype on a SurfaceHub
SIP: 93974461439(a)lync.zoom.us<https://ukri.zoom.us/skype/93974461439>
Hi everyone,
You can access the epic board via this link<https://isisneutronmuon.atlassian.net/jira/software/c/projects/SS/boards/5>
Please review the two epics that you can see in the "Analysis" column. Both of them are epics you have reviewed before, we have updated the descriptions to address the comments received.
In addition to that we would like to get some early feedback on two new epics that we are working on to improve the quality and release frequency of Mantid. These two epics are still being worked on, so the descriptions are not finalized.
1. Faster production-ready releases<https://isisneutronmuon.atlassian.net/browse/SS-41>: Aims to increase the frequency of Mantid releases.
2.
Enhancements to Mantid Error Reporting<https://isisneutronmuon.atlassian.net/browse/SS-42>: This aims to improve the error reporting of Mantid so that we can increase the % of fixes we do from the reports we get. It also aims to provide better communication about bug fix progress to people who report them.
Sharing your thoughts(as comments) on these will help us shape these epics for the better.
Also, regarding Jira notifications, the default behaviour is you will automatically get notifications about changes to an Epic if you have previously edited its content or added a comment. I can disable this behaviour if notifications have become an inconvenience for you.
If you want to unsubscribe notifications from a specific Epic, please take a look at the instructions attached.
Thank you.
--
Januka
Product Manager
Scientific Software Group
ISIS/STFC
[cid:e6229ce1-ab52-47a3-836c-65d1f079685a]<https://outlook.office.com/bookwithme/user/6a795b198fd04ba288e4fb1596d45c48…> Book time to meet with me<https://outlook.office.com/bookwithme/user/6a795b198fd04ba288e4fb1596d45c48…>
Morning All,
I see lots of activity updating the epics on the Kanban board ahead of our meeting on Nov 15. Which is good.
But presumably, ahead of the meeting, we are all going to be expected to have reviewed them (or at least a subset)? So I have two questions:
1) Which epics will require reviewing (which columns), and;
2) How much notice are we going to get that they are ready for review? Last meeting we were barely given two working days which was too short...
Perhaps we could agree an Epic Freeze date?
Steve
