Can we update open source LLMs weights without LoRA?

So what we’ve been doing for finetuning is do LoRA and merge the weights with the base model. But is there any way that we can finetune the weights without LoRA and update the weights of base model on a specific dataset?