Ad Widget

Collapse

AWS HTTP S3 Template not retrieving bucket data Zabbix 6.4

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • ObiLanKenobi
    Junior Member
    • May 2023
    • 1

    #1

    AWS HTTP S3 Template not retrieving bucket data Zabbix 6.4

    Hello there.

    Ive spent the last few days troubleshooting my issue regarding the new AWS HTTP templates for Zabbix 6.2 and 6.4, I ended up borking my entire Zabbix stack in the process so I am on a fresh Zabbix 6.4 installation for troubleshooting purposes.

    I have all the IAM Permissions configured correctly as per the documentation and am pretty familiar with IAM roles and permissions so I am confident it is not to do with that.

    I have managed to get the discovery working using the "AWS by HTTP" template built into Zabbix 6.4 which has discovered my s3 buckets and ec2 instances which is fantastic.

    The Live data on my discovered EC2 instances appears to be working, however the S3 buckets do not have any data, I spent some hours troubleshooting, the dependant script within "AWS S3 : Get Metrics Data" seems to be running and I am returned the following :

    [{"Id":"m0","Label":"BucketSizeBytes","StatusCode": "Complete","Timestamps":[],"Values":[]},{"Id":"m1","Label":"NumberOfObjects","StatusCode ":"Complete","Timestamps":[],"Values":[]},{"Id":"m2","Label":"AllRequests","StatusCode":"C omplete","Timestamps":[],"Values":[]},{"Id":"m3","Label":"GetRequests","StatusCode":"C omplete","Timestamps":[],"Values":[]},{"Id":"m4","Label":"PutRequests","StatusCode":"C omplete","Timestamps":[],"Values":[]},{"Id":"m5","Label":"DeleteRequests","StatusCode" :"Complete","Timestamps":[],"Values":[]},{"Id":"m6","Label":"HeadRequests","StatusCode":" Complete","Timestamps":[],"Values":[]},{"Id":"m7","Label":"PostRequests","StatusCode":" Complete","Timestamps":[],"Values":[]},{"Id":"m8","Label":"SelectRequests","StatusCode" :"Complete","Timestamps":[],"Values":[]},{"Id":"m9","Label":"SelectBytesScanned","StatusC ode":"Complete","Timestamps":[],"Values":[]},{"Id":"m10","Label":"SelectBytesReturned","Statu sCode":"Complete","Timestamps":[],"Values":[]},{"Id":"m11","Label":"ListRequests","StatusCode": "Complete","Timestamps":[],"Values":[]},{"Id":"m12","Label":"BytesDownloaded","StatusCod e":"Complete","Timestamps":[],"Values":[]},{"Id":"m13","Label":"BytesUploaded","StatusCode" :"Complete","Timestamps":[],"Values":[]},{"Id":"m14","Label":"4xxErrors","StatusCode":"Co mplete","Timestamps":[],"Values":[]},{"Id":"m15","Label":"5xxErrors","StatusCode":"Co mplete","Timestamps":[],"Values":[]},{"Id":"m16","Label":"FirstByteLatency p90","StatusCode":"Complete","Timestamps":[],"Values":[]},{"Id":"m17","Label":"TotalRequestLatency","Statu sCode":"Complete","Timestamps":[],"Values":[]},{"Id":"m18","Label":"FirstByteLatency p90","StatusCode":"Complete","Timestamps":[],"Values":[]},{"Id":"m19","Label":"ReplicationLatency","Status Code":"Complete","Timestamps":[],"Values":[]},{"Id":"m20","Label":"BytesPendingReplication","S tatusCode":"Complete","Timestamps":[],"Values":[]},{"Id":"m21","Label":"OperationsPendingReplicatio n","StatusCode":"Complete","Timestamps":[],"Values":[]}]
    This return of data gives me hope, however this returns a empty value in the live data.

    All the sub items e.g "AWS S3: Bucket Size" give null values also.

    Ive dug through the javascript code within the get metrics data to compare with the ec2 template, but im not overly familiar with analysing javascript to resolve the issue.

    I have not seen much other documentation out there by community members yet, so this seems like a quite recent issue, im not sure if im the only one experiencing it and it is a blunder on my part, or if this is a bug with the template.

    I was seeing a few errors in my log about "403 SignatureDoesNotMatch" from the template, but I have not seen them since making some changes to my setup.

    I did believe there were some syntax errors with the template javascript as there were some semicolons missing, but I added them in and it did not resolve the issue.

    I would love some help on this issue and learn further how to get this going, as this seems like a fantastic addition to zabbix.

    Thanks,
    Obi Lan
  • wmorris
    Junior Member
    • Jun 2023
    • 1

    #2
    I am also having the very same issue. I am receiving the same data set for my s3 bucket monitoring. Has there been any update/fix for this issue?

    Comment

    • alex_vy
      Junior Member
      • Apr 2020
      • 5

      #3
      Exact same problem here

      Comment

      • juanvoxel
        Junior Member
        • Jul 2023
        • 1

        #4
        In version 6.0 LTS also have the same problem. If anyone knows how to solve it, please share. Thanks

        Comment

        • BigSmooth
          Member
          • Jun 2023
          • 46

          #5
          I noticed the same issue. For a some reason, there is no {$AWS.REGION} macro in the discovery rule parameters.

          Comment

          • Brett-8149
            Junior Member
            • Nov 2023
            • 2

            #6
            Has anyone had any luck getting this to work? I'm having the same issue on 6.0 LTS, no information is reported back

            Comment

            • Javivu
              Junior Member
              • Aug 2023
              • 12

              #7
              Same issue on my side, with Zabbix 6.4.10 and last template version for 6.4... problems with S3 buckets no obtain any metric... any help¿?

              Comment

              • Markku
                Senior Member
                Zabbix Certified SpecialistZabbix Certified ProfessionalZabbix Certified Expert
                • Sep 2018
                • 1781

                #8
                Originally posted by Javivu
                Same issue on my side, with Zabbix 6.4.10 and last template version for 6.4... problems with S3 buckets no obtain any metric... any help¿?
                I take it that your error has changed? I mean, in your other post you had 403 (access denied), while here the problem is not access but empty data.

                Markku

                Comment

                • Javivu
                  Junior Member
                  • Aug 2023
                  • 12

                  #9
                  Hi to all, in my case I got an "Error: acces denied" when execute "Get metrics data". Then I try to debug the Javascript for this item.
                  Finally i found the error in the "AWS.getBucketFilterId" function... I do this workaround, because I don't use FilterID:
                  Code:
                  var region = AWS.getBucketLocation(AWS.params.bucket_name),
                        metrics = AWS.getMetricsData(region);
                  //var filter_id = AWS.getBucketFilterId(AWS.params.bucket_name, region);
                  //return JSON.stringify({ metrics, filter_id });
                  return JSON.stringify({ metrics });​
                  Bye

                  Comment

                  Working...