Manual Chapter : Logging Bot Defense requests

Applies To:

  • BIG-IQ Centralized Management

    7.1.0

Logging Bot Defense requests

BIG-IQ receives Bot Defense messages from BIG-IP via it’s Data Collection Devices (DCD). To optimize the process, while ensuring high availability, it is best to load balance log events to a remote logging pool of DCDs. This will prevent data loss, in the instance that a DCD becomes unavailable, without unnecessary duplication of information.

To complete this process for Bot Defense, you must have previously configured the following:

  • An imported and discovered BIG-IP device that hosts your Bot Defense profile and Bot Request logging profile.
  • A remote logging pool of DCDs configured to the service port number 8514.

For more information about configuring a remote pool of DCDs, see Connect Devices to a Data Collection Device Cluster in the Planning and Implementing a BIG-IQ Deploymentguide at support.f5.com.

Note: If you have already created or imported your logging profile, use this process to adjust the existing settings to include the remote logging pool of DCDs.

You must create a remote logging pool for the DCDs configured to the service port of your module. For more information see Connect Devices to a Data Collection Device cluster in the Planning and Implementing a BIG-IQ Deployment guide at support.f5.com.

Create a Remote High-Speed Log and Splunk-type Log Destination to specify that log messages are sent to your pool of DCDs.

  1. At the top of the screen, click Configuration, then, on the left, click LOCAL TRAFFIC > Logs > Log Destinations.

    The Log Destinations screen displays a list of the log destinations that are defined on this device.

  2. Click Create.

  3. Type a unique Namefor this destination.

  4. From the Type list, select Remote High-Speed Log

  5. From the Protocol list, select TCP.

  6. From the Device list, select the BIG-IP device that hosts your service module’s policy or profile.

  7. From the Pool list, select your pool of DCDs.

  8. Click Save & Close.

    The Log Destinations screen opens.

  9. Click Create.

  10. Type a unique Name for this destination.

  11. From the Type list, select Splunk.

  12. Under the Forward To field, select Remote High-Speed Log, and select the Remote High-Speed log saved in step 8.

  13. Click Save & Close.

You have now designated your DCD pool as a remote destination for BIG-IP to send its logging data. If your system has multiple modules that require event logging, ensure that you repeat this process for the module’s designated DCD pool.

Create a Log Publisher to specify that BIG-IP system sends log messages to BIG-IQ. When configuring your Log Publisher ensure you are adding the Splunk-type Log Destination.

Create a remote logging pool of DCDs, and specify your BIG-IQ’s DCD pool as a remote Log Destination.

Create a Log Publisher to specify to your managed BIG-IP device to send log messages to BIG-IQ.

Important: If you are configuring logging for the following service modules, you do not need to create a new Log Publisher:

  • Web Application Security (ASM or Adv. WAF)
  • DoS Protection
  • Network Security (AFM)

To complete this process, proceed to the following service module procedures:

  • Configure logging for Web Application Security
  • Configure logging for DoS Protection and Network Security
  1. At the top of the screen, click Configuration, then, on the left, click LOCAL TRAFFIC > Logs > Log Publishers.

    The screen displays a list of the Log Publishers that are defined on this device.

  2. Click Create.

  3. Under Name type a unique name for this publisher.

  4. In the Log Destination area, move the splunk-type log destination from the Available list to the Selected list.

  5. Click Save & Close.

  6. Pin the new log publisher to your host BIG-IP device:

    1. Go to Configuration > LOCAL TRAFFIC > Pinning Policies.

    2. Click the name of the BIG-IP device under the Pinning Policy column.

      If you have multiple devices, select the check box next to the names of the BIG-IP devices pinning policy to which you will pin the log publisher, and click Pin to Multiple Policies.

      The properties screen opens.

    3. In the center of the screen, locate the Local Traffic (LTM) field and select Log Publishers from the drop down list.

    4. Select the box next to the name of the log publisher created from the list in the bottom half of the screen.

    5. Click Add Selected.

    6. Click Save & Close.

You have now created a log publisher that specifies to BIG-IP to send log messages to the BIG-IQ DCD pool.

Create or edit a logging profile for your service module that specifies which logging data to collect and to send information to the proper log publisher.

Before you can log bot requests, you must first have the following:

  • One or more BIG-IP devices that are provisioned to have Bot Defense.
  • A remote logging pool of your DCDs that is connected to a virtual server deployed over a load balancing BIG-IP device.
  • Web Application Security is active for DCD services (see System > BIG-IQ DATA COLLECTION DEVICES > SERVICES)

Important: The following procedure is for Bot Defense profiles configured to BIG-IP devices version 14.1 or later. For logging bot request information from earlier versions of BIG-IP, see Configuring logging for DoS Protection and Network Security.

You can view bot request information by attaching a logging profile to the virtual servers that host your Bot Defense profile. To access Bot Defense information, you need to configure the BIG-IP system to send log information to BIG-IQ. This is done by:

  • Creating a log publisher and pin it to your BIG-IP device(s)
  • Creating and attaching a bot request logging profile in Shared Security
  • Deploying your changes over your BIG-IP device(s)

For more details about specific settings within the logging profile, see Configure logging for Bot Defense requests**.**

  1. Click Configuration > SECURITY > Shared Security > Logging Profiles.

  2. Click Create to create a remote bot logging profile.

  3. Type a unique Name for this logging profile.

  4. On the left, click BOT DEFENSE.

  5. For Status, select the Enabled check box.

    The screen displays the Bot Defense request logging properties.

  6. From the Remote Publisher list, select the logging publisher for your DCD pool.

  7. Enable the for the appropriate request types of logging in the remaining fields.

  8. When you are done, click Save & Close.

  9. Attach the new logging profile to a Shared Security virtual server.

    1. Go to Configuration > SECURITY > Shared Security > Virtual Servers.

    2. Select the virtual server that hosts your Bot Defense profile.

    3. From the Logging Profiles field, select the logging profile created in step 6, and use the arrow to move it to the Selected list.

    4. Click Save & Close.

    5. Repeat step 6 for any additional virtual servers that host Bot Defense profiles.

  10. Deploy your new pool, log destinations and log publisher over your BIG-IP device.

    1. Go to Deployment > EVALUATE & DEPLOY > Local Traffic & Network.

    2. In the Deployments list at the bottom half of the screen and click Create.

    3. In the Name field add a unique name.

    4. Ensure that Source and Source Scope fields are marked Current Changes and All Changes, respectively.

    5. From the Target Devices list, select the host BIG-IP device(s) over which to deploy changes.

    6. Click Create.

      The deployment is added the to Evaluations list.

    7. Once the evaluation is complete, click the box next to the deployment name and click Deploy.

    The new local traffic objects are deployed over the BIG-IP device.

  11. Deploy changes to your Shared Security virtual server.

    1. Go to Deployment > EVALUATE & DEPLOY > Shared Security.

    2. Repeat steps 10b-g.

      The new logging profile on your Shared Security virtual server is now deployed over the BIG-IP device.

You can now monitor detected bot requests from the bot request log, from Monitoring > EVENTS > Bot > Bot Requests.