{"type":"doc","content":[{"type":"extension","attrs":{"extensionType":"com.atlassian.confluence.macro.core","extensionKey":"toc","parameters":{"macroParams":{"indent":{"value":"10px"}},"macroMetadata":{"macroId":{"value":"ebaf4f98-ff70-478e-b34b-c3fc9af69110"},"schemaVersion":{"value":"1"},"title":"Table of Contents"}}}},{"type":"heading","attrs":{"level":2},"content":[{"text":"What is it?","type":"text"}]},{"type":"paragraph","content":[{"text":"The ability to provide queries with large response sizes and/or long running times in bucketed chunks, ie. Get all calls would be a good candidate for this","type":"text"}]},{"type":"mediaSingle","attrs":{"layout":"align-start","width":49.0},"content":[{"type":"media","attrs":{"width":635,"id":"3544adf4-5328-496b-b08e-02c2af8ba6d8","collection":"contentId-16316989","type":"file","height":236}}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Why have it?","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Pagination can help both api consumers and save our server resources","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"By returning results in chunks, this allows for quicker response times, less constant resource load on our server (avoids tying up a thread for an extended period of time) and provides more manageable amounts of data","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The most common use case for using pagination is any UI requesting data (as speed is key, you don’t want to keep your user waiting) or any client that is concerned with performance or response size and can handle receiving results in chunks","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"How is it implemented?","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Currently only implemented in the resources & traversal microservices","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Accepts resultSize and resultIndex as query parameters","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The resultSize is an integer passed in by the client as a query parameter that specifies what amount of results should be returned","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The resultIndex is an integer that is passed in by a client as a query parameter that specifies which bucket the client wants back ie. for a resultSize of 10 an index of 1 would return 1-10, index of 2 would return 11-20 etc","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The results are returned with the below information in the header, the parameters passed in, total amount of results, and total amount of pages","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"Optionally we could choose to include a flag to say has more results for ease of use, but this could also be derived by checking if resultIndex == total-pages","type":"text"},{"type":"hardBreak"},{"type":"hardBreak"}]},{"type":"mediaSingle","attrs":{"layout":"align-start","width":28.0},"content":[{"type":"media","attrs":{"width":488,"id":"c8746852-1348-42f0-98b8-1f1c8a3e1afb","collection":"contentId-16316989","type":"file","height":329}}]},{"type":"paragraph","content":[{"type":"hardBreak"},{"type":"hardBreak"}]}]}]},{"type":"heading","attrs":{"level":5},"content":[{"text":"curl example","type":"text","marks":[{"type":"strong"}]}]},{"type":"codeBlock","content":[{"text":"curl --verbose --silent --insecure --user AAI:AAI --header 'Accept: application/json' \\\n --header 'X-TransactionId: testaai' --header 'Content-Type: application/json' --header 'X-FromAppId: AAI' \\\n 'https://:30233/aai/v14/nodes/pnfs?resultIndex=1&resultSize=10'\n\n\n> GET /aai/v14/nodes/pnfs?resultIndex=1&resultSize=10 HTTP/1.1^M\n> Authorization: Basic QUFJOkFBSQ==^M\n> User-Agent: curl/7.29.0^M\n> Host: :30233^M\n> Accept: application/json^M\n> X-TransactionId: testaai^M\n> Content-Type: application/json^M\n> X-FromAppId: AAI^M\n> ^M\n< HTTP/1.1 200 OK^M\n< Date: Mon, 18 Feb 2019 23:40:49 GMT^M\n< vertex-id: 82300928^M\n< total-results: 1^M\n< total-pages: 1^M\n< Content-Type: application/json^M\n< X-AAI-TXID: 2-aai-resources-190218-23:40:49:594-65208^M\n< Content-Length: 158^M\n< Strict-Transport-Security: max-age=16000000; includeSubDomains; preload;^M\n< ^M\n{ [data not shown]\n* Connection #0 to host left intact\n{\n \"pnf\": [\n {\n \"pnf-name\": \"pnf-test-3\",\n \"pnf-name2\": \"name 2-3\",\n \"pnf-id\": \"test-id-3\",\n \"equip-type\": \"test-type-3\",\n \"in-maint\": false,\n \"resource-version\": \"1550533245515\"\n }\n ]\n}\n\n","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"In order for pagination to work properly the order must remain consistent","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"The way this is achieved is the vertices are pre sorted on disk by vertex-id (this is done by default)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"When a call is made to retrieve all vertices we get them sorted by vertex-id (since they are indexed this is very quick)","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"We then take a sublist of those vertices based on the pagination parameters and gather all information associated to them (this step and the network transfer of less data is where the time/resources is saved)","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"An Example","type":"text"}]},{"type":"bulletList","content":[{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET ALL https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers 11208 ms 3.54mb 8983 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 1 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=1&resultSize=1000 911 ms 408kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 2 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=2&resultSize=1000 901 ms 416kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 3 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=3&resultSize=1000 937 ms 407kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 4 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=4&resultSize=1000 1009 ms 409kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 5 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=5&resultSize=1000 1029 ms 397kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 6 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=6&resultSize=1000 878 ms 399kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 7 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=7&resultSize=1000 886 ms 394kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 8 of 1000 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=8&resultSize=1000 919 ms 404kb 1000 results","type":"text"}]}]},{"type":"listItem","content":[{"type":"paragraph","content":[{"text":"GET Page 9 of 983 results https://{{hostname}}:{{port}}/aai/{{version}}/cloud-infrastructure/pservers?resultIndex=9&resultSize=1000 940 ms 394kb 983 results","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Important Additional Information","type":"text"}]},{"type":"paragraph","content":[{"text":"If you are doing processing using pagination be aware that the results are returned in chunks dynamically for the chunks present at the given time of the query, there is no concept of persistence of an original set of results.","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"So say you come in and ask for resultIndex=1&resultSize=1 and there are 10 entries","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"[","type":"text"},{"text":"Node 1","type":"text","marks":[{"type":"strong"}]},{"text":"], Node 2, Node 3, Node 4, Node 5, Node 6, Node 7, Node 8, Node 9, Node 10","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Then you say resultIndex=2&resultSize=1 you get that Node 2","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Node 1, [","type":"text"},{"text":"Node 2]","type":"text","marks":[{"type":"strong"}]},{"text":", Node 3, Node 4, Node 5, Node 6, Node 7, Node 8, Node 9, Node 10","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Then say Node 1 gets deleted","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Node 2, Node 3, Node 4, Node 5, Node 6, Node 7, Node 8, Node 9, Node 10","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Then say you ask for resultIndex=3&resultSize=1 you would get Node 4 because now the entire set is different","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"text":"Node 2, Node 3, [","type":"text"},{"text":"Node 4","type":"text","marks":[{"type":"strong"}]},{"text":"], Node 5, Node 6, Node 7, Node 8, Node 9, Node 10","type":"text"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]},{"type":"paragraph","content":[{"type":"hardBreak"}]}],"version":1}

Browser not supported