How to use populate and aggregate in same statement?

In Mongoose, populate and aggregate are both powerful tools for handling MongoDB document references. populate is used to automatically replace specified paths in documents with the referenced documents. aggregate is a more powerful tool that can perform complex data processing, such as grouping, sorting, and calculating fields.

Until recently, populate and aggregate could not be directly combined. However, the latest version of Mongoose allows using the $lookup operator within the aggregate pipeline to achieve functionality similar to populate. This means you can now leverage the powerful capabilities of aggregate within the same query while populating data.

Here is an example using aggregate in Mongoose with functionality similar to populate:

Assume we have two collections, authors and books. Each book document has a field author that contains a reference to its corresponding author document.

Mongoose's aggregate method allows you to add multiple stages to the pipeline, and the $lookup stage can be used to achieve functionality similar to populate:

javascript
const Book = mongoose.model('Book');

Book.aggregate([
  {
    $lookup: {
      from: 'authors', // Specifies the name of the authors collection in the database
      localField: 'author', // The field in the book document pointing to the author
      foreignField: '_id', // The _id field in the authors collection
      as: 'authorDetails' // The field name to add to the result document, containing all matching documents
    }
  },
  {
    $unwind: '$authorDetails' // Unwinds the authorDetails array, converting it into a single document field
  },
  // Other possible aggregation stages, such as $match, $group, $sort, etc.
  // ...
]).exec((err, books) => {
  if (err) throw err;
  console.log(books);
});

In this example, $lookup is used to join the books collection and the authors collection. localField and foreignField specify the matching fields locally and externally, respectively. The as field specifies the output field for the lookup results. In this way, the aggregate query can return documents with associated data, similar to how populate works.

Note that $lookup can only be used with MongoDB 3.2 or later versions, and it requires that the related collections reside in the same database. Moreover, the $unwind stage is optional and is only needed when you know each match corresponds to a single document. (In a one-to-many relationship, $unwind will produce multiple documents.)

In summary, by combining aggregate with $lookup, you can achieve complex queries while populating data from other collections. This approach provides greater flexibility and control compared to traditional populate.