From Mark.SPILLMAN at 3ds.com Thu Apr 4 12:25:05 2024 From: Mark.SPILLMAN at 3ds.com (SPILLMAN Mark) Date: Thu, 4 Apr 2024 09:25:05 +0000 Subject: [Cod-bugs] Query about terms of use Message-ID: Dear COD team, I am writing to ask you if there is any guidance on acceptable "terms of use" for querying the OPTIMADE endpoint, for example, guidance on the number of queries a user should submit within a given time, or any other limits on use (e.g. rate limits, concurrent requests etc). I tried to find something to that effect on the website and also via the /info endpoint, but wasn't able to see anything. I also wanted to ask if there was an obvious way to find the maximum page_limit argument for OPTIMADE requests - it seems to vary depending on which parameters are requested. For example, if I include &response_fields=cartesian_site_positions in my query, then page_limit max is 10. However, if this is not included, then page_limit max is 100. Many thanks and best wishes, Mark This email and any attachments are intended solely for the use of the individual or entity to whom it is addressed and may be confidential and/or privileged. If you are not one of the named recipients or have received this email in error, (i) you should not read, disclose, or copy it, (ii) please notify sender of your receipt by reply email and delete this email and all attachments, (iii) Dassault Syst?mes does not accept or assume any liability or responsibility for any use of or reliance on this email. Please be informed that your personal data are processed according to our data privacy policy as described on our website. Should you have any questions related to personal data protection, please contact 3DS Data Protection Officer https://www.3ds.com/privacy-policy/contact/ -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. -------------- next part -------------- An HTML attachment was scrubbed... URL: From andrius.merkys at gmail.com Fri Apr 5 10:43:20 2024 From: andrius.merkys at gmail.com (Andrius Merkys) Date: Fri, 5 Apr 2024 10:43:20 +0300 Subject: [Cod-bugs] Query about terms of use In-Reply-To: References: Message-ID: <84ee67e9-3e96-4f74-be3c-4d6c195d6a87@gmail.com> Dear Mark, On 2024-04-04 12:25, SPILLMAN Mark wrote: > I am writing to ask you if there is any guidance on acceptable ?terms of > use? for querying the OPTIMADE endpoint, for example, guidance on the > number of queries a user should submit within a given time, or any other > limits on use (e.g. rate limits, concurrent requests etc). > > I tried to find something to that effect on the website and also via the > /info endpoint, but wasn?t able to see anything. You are right, at the moment there are no explicit terms of use regarding the COD server load. In the upcoming OPTIMADE release v1.2.0 there is going to be a field 'request_delay' providing the back-off time in seconds before the next request [1]. I think the sensible amount of time between requests from the same source should be at least 0.5s in order not to overload our servers. Concurrent requests are allowed, but the same guidelines should be respected. This means that posting concurrent requests on two parallel treads every second should be fine. At the moment the COD does not enforce these guidelines. Nevertheless we would like to kindly ask the COD users to introduce sensible delays in their software if it is going to make many requests to the COD. > I also wanted to ask if there was an obvious way to find the maximum > page_limit argument for OPTIMADE requests ? it seems to vary depending > on which parameters are requested. For example, if I include > &response_fields=cartesian_site_positions in my query, then page_limit > max is 10. However, if this is not included, then page_limit max is 100. There is no obvious way to find the maximum limits at the moment. The COD uses 'page_limit' of 100 for queries not needing atom site information, and 10 for queries which do. The limit is made to be lower for resource-intensive queries as site information in the COD is extracted on-the-fly at the moment. Once we make this more effective, the maximum limit on 'page_limit' will be increased. [1] https://github.com/Materials-Consortia/OPTIMADE/pull/411 Best regards, Andrius -- Andrius Merkys Vilnius University Institute of Biotechnology, Saul?tekio al. 7 LT-10257 Vilnius, Lithuania -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.