Purging Service in BCC


PurgingService is service which is used to purge older versions of assets in Publishing Schema. This component is available in Publishing.base module.


Question: I am using this service for first time. Are there any prerequisites?
Answer: Yes, following are the prerequisites that needs to followed.

1. Delete all "Author" state projects which are not in use for week or month.
2. Close all the projects which are waiting for acceptance.
3. Halt the BCC deployments if any.
4. Do not Create any project till the Purging service is complete. Accessing BCC is not advisable during purging. 
5. Increase the DB Transaction time out to MAX for PUB JVM.
6. Last, Take a back up of File system and Publishing DB.



Question: Okies, I have achieved above prerequisites. How should I proceed further?
Answer: Access the Dyn/admin of BCC and search for component "PurgingService". Entire Purging service is divided into following sections.

1. Generating Report

Generate Report stating how many assets are going to be purged. Provide Days prior to which assets needs to purged.


2. Submit Purge

Once report is generated, you can submit the for purging or cancel.



































Final result will be shown once the purge is complete.























Question: I am done with purging. Are there any post requisites?
Answer: Yes, Indexes in Publishing DB will be disturbed. Please rebuild indexes in Publishing DB.


Question: Cool. Are there any good to know information about Purging Service?
Answer: If you are planning to Purge assets older than 7 days, you can break it into small parts.
1. First purge assets older than 100 days.
2. Next purge assets older than 50 days.
3. And Lastly purge assets older than 7 days.

Before Running Purging Service in Production, it's good to be tried out in replica of Production first.

21 comments:

  1. Hi Iranna,

    What could be the reason's that one wants to Purge Data from BCC versioning system ?
    If we don't Purge Anything ever, will that hamper any performance of our BCC Deployments ?

    ReplyDelete
    Replies
    1. More the number of assets, slower the Database would respond to each queries. Purging the older assets at least per year is recommended, else it would impact following functionalities.
      1. Slower view/modification of assets in BCC
      2. Initial Phase of deployments would be slower, but not complete deployment process.
      3. Heavier the Pub Schema.

      Purging helps a lot, when you millions of millions assets maintained at Publishing Schemas.

      Delete
  2. Hi, I´ve many asset versions on my ATG 11.1 since 2015 Oct (~170 days) and the purge doesn´t work even when I try to clean 20 days.
    I´m executing a test to clean by each 5 days and it´s working but it´s taking between 6 hours and 20 hours each execution.

    Is there any way to speed up it or increase the number of days to clean?

    ReplyDelete
    Replies
    1. Yes, purgingservice is most time consuming activity. But there are certain ways where we can optimize the performance. So when purgingService is called, it triggers series of SQL queries in PUB DB, going each repository. If the time taken is more, it will be from DB queries. So get the most time consuming queries from DB. Analyse the SQL queries. And add index over the required columns. It will really increase the performance from 6 hours to 1 hour for sure.

      Delete
  3. if I want to purge the data in between two dates. how can we achieve this?

    ReplyDelete
  4. It is not possible from DYN/Admin. But what you can do is, take SQL logs when purgingservice is invoked. And convert the SQL queries to have timestamp in between. And then execute the same SQL queries in Pub DB. But this is not recommended approach.

    ReplyDelete
    Replies
    1. Thanks Iranna,
      I have one more query, I have run the PurgingService but two validations got failed:
      Valid Deployed Snapshot
      Deployed Snapshot Date

      Could you please help me to trace the issue.

      Thanks,
      Geeta

      Delete
  5. ok, thank you..
    I have one more question when I hit PurgingService I got the metrics report but two of the validations failed:
    Valid Deployed snapshot and Deployed snapshot date.

    because of this Submit Purge is not enabled. Could you please help me to trigger out this?

    Thanks'
    Geeta

    ReplyDelete
  6. Thanks Iranna, I have one more query I have run the PurgingService I got the metrics report with the below two validatins got failed:
    Valid deployed snapshot and Deployed Snapshot Date.

    Could you please help me to trigger out the issue.

    Thanks,
    Geeta

    ReplyDelete
  7. Thanks Iranna,
    I have one more query, I have run the PurgingService but two validations got failed:
    Valid Deployed Snapshot
    Deployed Snapshot Date

    Could you please help me to trace the issue.

    Thanks,
    Geeta

    ReplyDelete
  8. Thanks Iranna,
    I have one more query, I have run the PurgingService but two validations got failed:
    Valid Deployed Snapshot
    Deployed Snapshot Date

    Could you please help me to trace the issue.

    Thanks,
    Geeta

    ReplyDelete
  9. Hi Iranna,
    I have one query.Did some changes in prod schema after that started Publishing Server.After login to BCC not able to see list of projects.
    Could you please help me to trace the issue.

    Thanks
    Shrikant

    ReplyDelete
  10. Hi Iranna ,
    1) When we hit Submit purge , is there any way by which can figure how much time required for the operation ?
    2) Is there any article to automate this complete process

    ReplyDelete
  11. Hi Iranna,

    Is it advisable to use purgingService for a small number of records? If not what would be an ideal minimum number of records when deciding to use this system as opposed to a delete rest call for multiple records with a list of ids. Also does it work for atg agent side records too?

    ReplyDelete
  12. Is there any SQL to purge BCC assets instead of the dyn/admin purging process?

    ReplyDelete
  13. Yes, I saw it in a forum but I don't recommend that. As soon as you customize the Oracle Commerce/ATG, new tables are created and any script from any forum won't fit your reality.

    ReplyDelete
  14. I know some guy who just developed his own module to import catalogs so fast. It avoid approvals, stagings, history, versions, etc. He just tested the Oracle Commerce PAAS in the Oracle Cloud and the performance still bad as ever.

    ReplyDelete
  15. As Mori commented, a script to perform the Purge is not recommended, especially if there are numerous custom tables. We even opened a SR at Oracle and they also did not recommend it.
    We also customized the catalog import, now the process no longer runs by the versioning system (Creating projects in the BCC) for updates, only for new items, so we decrease the frequency of Purging.

    ReplyDelete
  16. Thanks for blog posting
    Sanjary Kids is one of the best play school and preschool in Hyderabad,India. Give your child the best preschool experience by choosing the best playschool of Hyderabad in Abids. we provide programs like Play group,Nursery,Junior KG,Senior KG,and provides Teacher Training Program.
    Preschool in hyderabad

    ReplyDelete
  17. Good blog I liked it

    Sanjary Academy is the best Piping Design institute in Hyderabad, Telangana. It is the best Piping design Course in India and we have offer professional Engineering Courses like Piping design Course, QA/QC Course, document controller course, Pressure Vessel Design Course, Welding Inspector Course, Quality Management Course and Safety Officer Course.
    best Piping Design Course
    piping design course with placement
    Piping Design Course
    Piping Design Course in Hyderabad ­
    Piping Design Course in India­
    best Piping Design institute
    best institute of Piping Design Course in India

    ReplyDelete
  18. Dil Bechara 2020 FHD Download Here
    Sushant Singh Rajput Last Movie Dil Bechara 2020 Download HDRip

    ReplyDelete